arXiv subjects

Katherine L. Bouman

Publications and source records attributed to Katherine L. Bouman.

At least 55 records · Page 3Linked to original sources

arXiv2024

Score-Based Diffusion Models for Photoacoustic Tomography Image Reconstruction

Photoacoustic tomography (PAT) is a rapidly-evolving medical imaging modality that combines optical absorption contrast with ultrasound imaging depth. One challenge in PAT is image reconstruction with inadequate acoustic signals due to limited sensor coverage or due to the density of the transducer array. Such cases call for solving an ill-posed inverse reconstruction problem. In this work, we use score-based diffusion models to solve the inverse problem of reconstructing an image from limited PAT measurements. The proposed approach allows us to incorporate an expressive prior learned by a diffusion model on simulated vessel structures while still being robust to varying transducer sparsity conditions.

physics.med-ph↗

arXiv2023

Single View Refractive Index Tomography with Neural Fields

Refractive Index Tomography is the inverse problem of reconstructing the continuously-varying 3D refractive index in a scene using 2D projected image measurements. Although a purely refractive field is not directly visible, it bends light rays as they travel through space, thus providing a signal for reconstruction. The effects of such fields appear in many scientific computer vision settings, ranging from refraction due to transparent cells in microscopy to the lensing of distant galaxies caused by dark matter in astrophysics. Reconstructing these fields is particularly difficult due to the complex nonlinear effects of the refractive field on observed images. Furthermore, while standard 3D reconstruction and tomography settings typically have access to observations of the scene from many viewpoints, many refractive index tomography problem settings only have access to images observed from a single viewpoint. We introduce a method that leverages prior knowledge of light sources scattered throughout the refractive medium to help disambiguate the single-view refractive index tomography problem. We differentiably trace curved rays through a neural field representation of the refractive field, and optimize its parameters to best reproduce the observed image. We demonstrate the efficacy of our approach by reconstructing simulated refractive fields, analyze the effects of light source distribution on the recovered field, and test our method on a simulated dark matter mapping problem where we successfully recover the 3D refractive field caused by a realistic dark matter distribution.

cs.CV↗

arXiv2023

Filamentary structures as the origin of blazar jet radio variability

Supermassive black holes at the centre of active galactic nuclei power some of the most luminous objects in the Universe. Typically, very long baseline interferometric (VLBI) observations of blazars have revealed only funnel-like morphologies with little information of the ejected plasma internal structure, or lacked the sufficient dynamic range to reconstruct the extended jet emission. Here we show microarcsecond-scale angular resolution images of the blazar 3C 279 obtained at 22 GHz with the space VLBI mission RadioAstron, which allowed us to resolve the jet transversely and reveal several filaments produced by plasma instabilities in a kinetically dominated flow. Our high angular resolution and dynamic range image suggests that emission features traveling down the jet may manifest as a result of differential Doppler-boosting within the filaments, as opposed to the standard shock-in-jet model invoked to explain blazar jet radio variability. Moreover, we infer that the filaments in 3C 279 are possibly threaded by a helical magnetic field rotating clockwise, as seen in the direction of the flow motion, with an intrinsic helix pitch angle of ~45 degrees in a jet with a Lorentz factor of ~13 at the time of observation.

astro-ph.HE↗

arXiv2023

Discovering Structure From Corruption for Unsupervised Image Reconstruction

We consider solving ill-posed imaging inverse problems without access to an image prior or ground-truth examples. An overarching challenge in these inverse problems is that an infinite number of images, including many that are implausible, are consistent with the observed measurements. Thus, image priors are required to reduce the space of possible solutions to more desirable reconstructions. However, in many applications it is difficult or potentially impossible to obtain example images to construct an image prior. Hence inaccurate priors are often used, which inevitably result in biased solutions. Rather than solving an inverse problem using priors that encode the spatial structure of any one image, we propose to solve a set of inverse problems jointly by incorporating prior constraints on the collective structure of the underlying images. The key assumption of our work is that the underlying images we aim to reconstruct share common, low-dimensional structure. We show that such a set of inverse problems can be solved simultaneously without the use of a spatial image prior by instead inferring a shared image generator with a low-dimensional latent space. The parameters of the generator and latent embeddings are found by maximizing a proxy for the Evidence Lower Bound (ELBO). Once identified, the generator and latent embeddings can be combined to provide reconstructed images for each inverse problem. The framework we propose can handle general forward model corruptions, and we show that measurements derived from only a small number of ground-truth images ($\leqslant 150$) are sufficient for image reconstruction. We demonstrate our approach on a variety of convex and non-convex inverse problems, including denoising, phase retrieval, and black hole video reconstruction.

eess.IV↗

arXiv2023

A search for pulsars around Sgr A* in the first Event Horizon Telescope dataset

The Event Horizon Telescope (EHT) observed in 2017 the supermassive black hole at the center of the Milky Way, Sagittarius A* (Sgr A*), at a frequency of 228.1 GHz ($λ$=1.3 mm). The fundamental physics tests that even a single pulsar orbiting Sgr A* would enable motivate searching for pulsars in EHT datasets. The high observing frequency means that pulsars - which typically exhibit steep emission spectra - are expected to be very faint. However, it also negates pulse scattering, an effect that could hinder pulsar detections in the Galactic Center. Additionally, magnetars or a secondary inverse Compton emission could be stronger at millimeter wavelengths than at lower frequencies. We present a search for pulsars close to Sgr A* using the data from the three most-sensitive stations in the EHT 2017 campaign: the Atacama Large Millimeter/submillimeter Array, the Large Millimeter Telescope and the IRAM 30 m Telescope. We apply three detection methods based on Fourier-domain analysis, the Fast-Folding-Algorithm and single pulse search targeting both pulsars and burst-like transient emission; using the simultaneity of the observations to confirm potential candidates. No new pulsars or significant bursts were found. Being the first pulsar search ever carried out at such high radio frequencies, we detail our analysis methods and give a detailed estimation of the sensitivity of the search. We conclude that the EHT 2017 observations are only sensitive to a small fraction ($\lesssim$2.2%) of the pulsars that may exist close to Sgr A*, motivating further searches for fainter pulsars in the region.

astro-ph.HE↗

arXiv2023

Score-Based Diffusion Models as Principled Priors for Inverse Imaging

Priors are essential for reconstructing images from noisy and/or incomplete measurements. The choice of the prior determines both the quality and uncertainty of recovered images. We propose turning score-based diffusion models into principled image priors ("score-based priors") for analyzing a posterior of images given measurements. Previously, probabilistic priors were limited to handcrafted regularizers and simple distributions. In this work, we empirically validate the theoretically-proven probability function of a score-based diffusion model. We show how to sample from resulting posteriors by using this probability function for variational inference. Our results, including experiments on denoising, deblurring, and interferometric imaging, suggest that score-based priors enable principled inference with a sophisticated, data-driven image prior.

cs.CV↗

arXiv2023

Visual Vibration Tomography: Estimating Interior Material Properties from Monocular Video

An object's interior material properties, while invisible to the human eye, determine motion observed on its surface. We propose an approach that estimates heterogeneous material properties of an object from a monocular video of its surface vibrations. Specifically, we show how to estimate Young's modulus and density throughout a 3D object with known geometry. Knowledge of how these values change across the object is useful for simulating its motion and characterizing any defects. Traditional non-destructive testing approaches, which often require expensive instruments, generally estimate only homogenized material properties or simply identify the presence of defects. In contrast, our approach leverages monocular video to (1) identify image-space modes from an object's sub-pixel motion, and (2) directly infer spatially-varying Young's modulus and density values from the observed modes. We demonstrate our approach on both simulated and real videos.

cs.CV↗

arXiv2023

Key Science Goals for the Next-Generation Event Horizon Telescope

The Event Horizon Telescope (EHT) has led to the first images of a supermassive black hole, revealing the central compact objects in the elliptical galaxy M87 and the Milky Way. Proposed upgrades to this array through the next-generation EHT (ngEHT) program would sharply improve the angular resolution, dynamic range, and temporal coverage of the existing EHT observations. These improvements will uniquely enable a wealth of transformative new discoveries related to black hole science, extending from event-horizon-scale studies of strong gravity to studies of explosive transients to the cosmological growth and influence of supermassive black holes. Here, we present the key science goals for the ngEHT and their associated instrument requirements, both of which have been formulated through a multi-year international effort involving hundreds of scientists worldwide.

astro-ph.HE↗

arXiv2023

Image Reconstruction without Explicit Priors

We consider solving ill-posed imaging inverse problems without access to an explicit image prior or ground-truth examples. An overarching challenge in inverse problems is that there are many undesired images that fit to the observed measurements, thus requiring image priors to constrain the space of possible solutions to more plausible reconstructions. However, in many applications it is difficult or potentially impossible to obtain ground-truth images to learn an image prior. Thus, inaccurate priors are often used, which inevitably result in biased solutions. Rather than solving an inverse problem using priors that encode the explicit structure of any one image, we propose to solve a set of inverse problems jointly by incorporating prior constraints on the collective structure of the underlying images.The key assumption of our work is that the ground-truth images we aim to reconstruct share common, low-dimensional structure. We show that such a set of inverse problems can be solved simultaneously by learning a shared image generator with a low-dimensional latent space. The parameters of the generator and latent embedding are learned by maximizing a proxy for the Evidence Lower Bound (ELBO). Once learned, the generator and latent embeddings can be combined to provide reconstructions for each inverse problem. The framework we propose can handle general forward model corruptions, and we show that measurements derived from only a few ground-truth images (O(10)) are sufficient for image reconstruction without explicit priors.

eess.IV↗

arXiv2023

The Event Horizon Telescope Image of the Quasar NRAO 530

We report on the observations of the quasar NRAO 530 with the Event Horizon Telescope (EHT) on 2017 April 5-7, when NRAO 530 was used as a calibrator for the EHT observations of Sagittarius A*. At z=0.902 this is the most distant object imaged by the EHT so far. We reconstruct the first images of the source at 230 GHz, at an unprecedented angular resolution of $\sim$ 20 $μ$as, both in total intensity and in linear polarization. We do not detect source variability, allowing us to represent the whole data set with static images. The images reveal a bright feature located on the southern end of the jet, which we associate with the core. The feature is linearly polarized, with a fractional polarization of $\sim$5-8% and has a sub-structure consisting of two components. Their observed brightness temperature suggests that the energy density of the jet is dominated by the magnetic field. The jet extends over 60 $μ$as along a position angle PA$\sim -$28$^\circ$. It includes two features with orthogonal directions of polarization (electric vector position angle, EVPA), parallel and perpendicular to the jet axis, consistent with a helical structure of the magnetic field in the jet. The outermost feature has a particularly high degree of linear polarization, suggestive of a nearly uniform magnetic field. Future EHT observations will probe the variability of the jet structure on $μ$as scales, while simultaneous multi-wavelength monitoring will provide insight into the high energy emission origin.

astro-ph.HE↗

arXiv2022

Collimation of the relativistic jet in the quasar 3C 273

The collimation of relativistic jets launched from the vicinity of supermassive black holes (SMBHs) at the centers of active galactic nuclei (AGN) is one of the key questions to understand the nature of AGN jets. However, little is known about the detailed jet structure for AGN like quasars since very high angular resolutions are required to resolve these objects. We present very long baseline interferometry (VLBI) observations of the archetypical quasar 3C 273 at 86 GHz, performed with the Global Millimeter VLBI Array, for the first time including the Atacama Large Millimeter/submillimeter Array. Our observations achieve a high angular resolution down to $\sim$60 ${\rm μ}$as, resolving the innermost part of the jet ever on scales of $\sim 10^5$ Schwarzschild radii. Our observations, including close-in-time High Sensitivity Array observations of 3C 273 at 15, 22, and 43 GHz, suggest that the inner jet collimates parabolically, while the outer jet expands conically, similar to jets from other nearby low luminosity AGN. We discovered the jet collimation break around $10^{7}$ Schwarzschild radii, providing the first compelling evidence for structural transition in a quasar jet. The location of the collimation break for 3C 273 is farther downstream the sphere of gravitational influence (SGI) from the central SMBH. With the results for other AGN jets, our results show that the end of the collimation zone in AGN jets is governed not only by the SGI of the SMBH but also by the more diverse properties of the central nuclei.

astro-ph.HE↗

arXiv2022

End-to-End Sequential Sampling and Reconstruction for MRI

Accelerated MRI shortens acquisition time by subsampling in the measurement $κ$-space. Recovering a high-fidelity anatomical image from subsampled measurements requires close cooperation between two components: (1) a sampler that chooses the subsampling pattern and (2) a reconstructor that recovers images from incomplete measurements. In this paper, we leverage the sequential nature of MRI measurements, and propose a fully differentiable framework that jointly learns a sequential sampling policy simultaneously with a reconstruction strategy. This co-designed framework is able to adapt during acquisition in order to capture the most informative measurements for a particular target. Experimental results on the fastMRI knee dataset demonstrate that the proposed approach successfully utilizes intermediate information during the sampling process to boost reconstruction performance. In particular, our proposed method can outperform the current state-of-the-art learned $κ$-space sampling baseline on over 96% of test samples. We also investigate the individual and collective benefits of the sequential sampling and co-design strategies.

eess.IV↗

arXiv2022

Deep Radio Interferometric Imaging with POLISH: DSA-2000 and weak lensing

Radio interferometry allows astronomers to probe small spatial scales that are often inaccessible with single-dish instruments. However, recovering the radio sky from an interferometer is an ill-posed deconvolution problem that astronomers have worked on for half a century. More challenging still is achieving resolution below the array's diffraction limit, known as super-resolution imaging. To this end, we have developed a new learning-based approach for radio interferometric imaging, leveraging recent advances in the classical computer vision problems of single-image super-resolution (SISR) and deconvolution. We have developed and trained a high dynamic range residual neural network to learn the mapping between the dirty image and the true radio sky. We call this procedure POLISH, in contrast to the traditional CLEAN algorithm. The feed forward nature of learning-based approaches like POLISH is critical for analyzing data from the upcoming Deep Synoptic Array (DSA-2000). We show that POLISH achieves super-resolution, and we demonstrate its ability to deconvolve real observations from the Very Large Array (VLA). Super-resolution on DSA-2000 will allow us to measure the shapes and orientations of several hundred million star forming radio galaxies (SFGs), making it a powerful cosmological weak lensing survey and probe of dark energy. We forecast its ability to constrain the lensing power spectrum, finding that it will be complementary to next-generation optical surveys such as Euclid.

astro-ph.IM↗

arXiv2022

alpha-Deep Probabilistic Inference (alpha-DPI): efficient uncertainty quantification from exoplanet astrometry to black hole feature extraction

Inference is crucial in modern astronomical research, where hidden astrophysical features and patterns are often estimated from indirect and noisy measurements. Inferring the posterior of hidden features, conditioned on the observed measurements, is essential for understanding the uncertainty of results and downstream scientific interpretations. Traditional approaches for posterior estimation include sampling-based methods and variational inference. However, sampling-based methods are typically slow for high-dimensional inverse problems, while variational inference often lacks estimation accuracy. In this paper, we propose alpha-DPI, a deep learning framework that first learns an approximate posterior using alpha-divergence variational inference paired with a generative neural network, and then produces more accurate posterior samples through importance re-weighting of the network samples. It inherits strengths from both sampling and variational inference methods: it is fast, accurate, and scalable to high-dimensional problems. We apply our approach to two high-impact astronomical inference problems using real data: exoplanet astrometry and black hole feature extraction.

astro-ph.IM↗

arXiv2022

Gravitationally Lensed Black Hole Emission Tomography

Measurements from the Event Horizon Telescope enabled the visualization of light emission around a black hole for the first time. So far, these measurements have been used to recover a 2D image under the assumption that the emission field is static over the period of acquisition. In this work, we propose BH-NeRF, a novel tomography approach that leverages gravitational lensing to recover the continuous 3D emission field near a black hole. Compared to other 3D reconstruction or tomography settings, this task poses two significant challenges: first, rays near black holes follow curved paths dictated by general relativity, and second, we only observe measurements from a single viewpoint. Our method captures the unknown emission field using a continuous volumetric function parameterized by a coordinate-based neural network, and uses knowledge of Keplerian orbital dynamics to establish correspondence between 3D points over time. Together, these enable BH-NeRF to recover accurate 3D emission fields, even in challenging situations with sparse measurements and uncertain orbital dynamics. This work takes the first steps in showing how future measurements from the Event Horizon Telescope could be used to recover evolving 3D emission around the supermassive black hole in our Galactic center.

cs.CV↗

arXiv2022

Self-Supervised Online Learning for Safety-Critical Control using Stereo Vision

With the increasing prevalence of complex vision-based sensing methods for use in obstacle identification and state estimation, characterizing environment-dependent measurement errors has become a difficult and essential part of modern robotics. This paper presents a self-supervised learning approach to safety-critical control. In particular, the uncertainty associated with stereo vision is estimated, and adapted online to new visual environments, wherein this estimate is leveraged in a safety-critical controller in a robust fashion. To this end, we propose an algorithm that exploits the structure of stereo-vision to learn an uncertainty estimate without the need for ground-truth data. We then robustify existing Control Barrier Function-based controllers to provide safety in the presence of this uncertainty estimate. We demonstrate the efficacy of our method on a quadrupedal robot in a variety of environments. When not using our method safety is violated. With offline training alone we observe the robot is safe, but overly-conservative. With our online method the quadruped remains safe and conservatism is reduced.

cs.RO↗

arXiv2022

MeqSilhouette v2: Spectrally-resolved polarimetric synthetic data generation for the Event Horizon Telescope

We present MeqSilhouette v2.0 (MeqSv2), a fully polarimetric, time-and frequency-resolved synthetic data generation software for simulating millimetre (mm) wavelength very long baseline interferometry (VLBI) observations with heterogeneous arrays. Synthetic data are a critical component in understanding real observations, testing calibration and imaging algorithms, and predicting performance metrics of existing or proposed sites. MeqSv2 applies physics-based instrumental and atmospheric signal corruptions constrained by empirically-derived site and station parameters to the data. The new version is capable of applying instrumental polarization effects and various other spectrally-resolved effects using the Radio Interferometry Measurement Equation (RIME) formalism and produces synthetic data compatible with calibration pipelines designed to process real data. We demonstrate the various corruption capabilities of MeqSv2 using different arrays, with a focus on the effect of complex bandpass gains on closure quantities for the EHT at 230 GHz. We validate the frequency-dependent polarization leakage implementation by performing polarization self-calibration of synthetic EHT data using PolSolve. We also note the potential applications for cm-wavelength VLBI array analysis and design and future directions.

astro-ph.IM↗

arXiv2021

Event Horizon Telescope observations of the jet launching and collimation in Centaurus A

Very-long-baseline interferometry (VLBI) observations of active galactic nuclei at millimeter wavelengths have the power to reveal the launching and initial collimation region of extragalactic radio jets, down to $10-100$ gravitational radii ($r_g=GM/c^2$) scales in nearby sources. Centaurus A is the closest radio-loud source to Earth. It bridges the gap in mass and accretion rate between the supermassive black holes (SMBHs) in Messier 87 and our galactic center. A large southern declination of $-43^{\circ}$ has however prevented VLBI imaging of Centaurus A below $λ1$cm thus far. Here, we show the millimeter VLBI image of the source, which we obtained with the Event Horizon Telescope at $228$GHz. Compared to previous observations, we image Centaurus A's jet at a tenfold higher frequency and sixteen times sharper resolution and thereby probe sub-lightday structures. We reveal a highly-collimated, asymmetrically edge-brightened jet as well as the fainter counterjet. We find that Centaurus A's source structure resembles the jet in Messier 87 on ${\sim}500r_g$ scales remarkably well. Furthermore, we identify the location of Centaurus A's SMBH with respect to its resolved jet core at $λ1.3$mm and conclude that the source's event horizon shadow should be visible at THz frequencies. This location further supports the universal scale invariance of black holes over a wide range of masses.

astro-ph.GA↗