arXiv subjects

Matthew Graham

Publications and source records attributed to Matthew Graham.

At least 73 records · Page 4Linked to original sources

arXiv2019

Recommendation or Discrimination?: Quantifying Distribution Parity in Information Retrieval Systems

Information retrieval (IR) systems often leverage query data to suggest relevant items to users. This introduces the possibility of unfairness if the query (i.e., input) and the resulting recommendations unintentionally correlate with latent factors that are protected variables (e.g., race, gender, and age). For instance, a visual search system for fashion recommendations may pick up on features of the human models rather than fashion garments when generating recommendations. In this work, we introduce a statistical test for "distribution parity" in the top-K IR results, which assesses whether a given set of recommendations is fair with respect to a specific protected variable. We evaluate our test using both simulated and empirical results. First, using artificially biased recommendations, we demonstrate the trade-off between statistically detectable bias and the size of the search catalog. Second, we apply our test to a visual search system for fashion garments, specifically testing for recommendation bias based on the skin tone of fashion models. Our distribution parity test can help ensure that IR systems' results are fair and produce a good experience for all users.

stat.ML↗

arXiv2019

GROWTH on S190426c. II. Real-Time Search for a Counterpart to the Probable Neutron Star-Black Hole Merger using an Automated Difference Imaging Pipeline for DECam

The discovery of a transient kilonova following the gravitational-wave event GW170817 highlighted the critical need for coordinated rapid and wide-field observations, inference, and follow-up across the electromagnetic spectrum. In the Southern hemisphere, the Dark Energy Camera (DECam) on the Blanco 4-m telescope is well-suited to this task, as it is able to cover wide-fields quickly while still achieving the depths required to find kilonovae like the one accompanying GW170817 to $\sim$500 Mpc, the binary neutron star horizon distance for current generation of LIGO/Virgo collaboration (LVC) interferometers. Here, as part of the multi-facility followup by the Global Relay of Observatories Watching Transients Happen (GROWTH) collaboration, we describe the observations and automated data movement, data reduction, candidate discovery, and vetting pipeline of our target-of-opportunity DECam observations of S190426c, the first possible neutron star--black hole merger detected via gravitational waves. Starting 7.5hr after S190426c, over 11.28\,hr of observations, we imaged an area of 525\,deg$^2$ ($r$-band) and 437\,deg$^2$ ($z$-band); this was 16.3\% of the total original localization probability and nearly all of the probability density visible from the Southern hemisphere. The machine-learning based pipeline was optimized for fast turnaround, delivering transient candidates for human vetting within 17 minutes, on average, of shutter closure. We reported nine promising counterpart candidates 2.5 hours before the end of our observations. Our observations yielded no detection of a bona fide counterpart to $m_z = 22.5$ and $m_r = 22.9$ at the 5$σ$ level of significance, consistent with the refined LVC positioning. We view these observations and rapid inferencing as an important real-world test for this novel end-to-end wide-field pipeline.

astro-ph.HE↗

arXiv2019

AGN (and other) astrophysics with Gravitational Wave Events

The stellar mass binary black hole (sBBH) mergers presently detected by LIGO may originate wholly or in part from binary black hole mergers embedded in disks of gas around supermassive black holes. Determining the contribution of these active galactic nucleus (AGN) disks to the sBBH merger rate enables us to uniquely measure important parameters of AGN disks, including their typical density, aspect ratio, and lifetime, thereby putting unique limits on an important element of galaxy formation. For the first time, gravitational waves will allow us to reveal the properties of the hidden interior of AGN disks, while electromagnetic radiation (EM) probes the disk photosphere. The localization of sBBH merger events from LIGO is generally insufficient for association with a single EM counterpart. However, the contribution to the LIGO event rate from rare source types (such as AGNs) can be determined on a statistical basis. To determine the contribution to the sBBH rate from AGNs in the next decade requires: {\em 1) a complete galaxy catalog for the LIGO search volume, 2) strategic multi-wavelength EM follow-up of LIGO events and 3) significant advances in theoretical understanding of AGN disks and the behavior of objects embedded within them.}

astro-ph.HE↗

arXiv2019

Multi-Messenger Astrophysics with Pulsar Timing Arrays

Pulsar timing arrays (PTAs) are on the verge of detecting low-frequency gravitational waves (GWs) from supermassive black hole binaries (SMBHBs). With continued observations of a large sample of millisecond pulsars, PTAs will reach this major milestone within the next decade. Already, SMBHB candidates are being identified by electromagnetic surveys in ever-increasing numbers; upcoming surveys will enhance our ability to detect and verify candidates, and will be instrumental in identifying the host galaxies of GW sources. Multi-messenger (GW and electromagnetic) observations of SMBHBs will revolutionize our understanding of the co-evolution of SMBHs with their host galaxies, the dynamical interactions between binaries and their galactic environments, and the fundamental physics of accretion. Multi-messenger observations can also make SMBHBs 'standard sirens' for cosmological distance measurements out to $z\simeq0.5$. LIGO has already ushered in breakthrough insights in our knowledge of black holes. The multi-messenger detection of SMBHBs with PTAs will be a breakthrough in the years $2020-2030$ and beyond, and prepare us for LISA to help complete our views of black hole demographics and evolution at higher redshifts.

astro-ph.HE↗

arXiv2019

Mapping the Inner Structure of Quasars with Time-Domain Spectroscopy

The ubiquitous variability of quasars across a wide range of wavelengths and timescales encodes critical information about the structure and dynamics of the circumnuclear emitting regions that are too small to be directly resolved, as well as detailed underlying physics of accretion and feedback processes in these active supermassive black holes. We emphasize the importance of studying quasar variability with time-domain spectroscopy, focusing on two science cases: (1) reverberation mapping (RM) to measure the broad-line region sizes and black hole masses in distant quasars; (2) spectroscopic follow-up of extreme variability quasars that dramatically change their continuum and broad-line flux within several years. We highlight the need for dedicated optical-infrared spectroscopic survey facilities in the coming decades to accompany wide-area time-domain imaging surveys, including: (1) the next phase of the Sloan Digital Sky Survey (SDSS-V; ~2020-2025), an all-sky, time-domain multi-object spectroscopic survey with 2.5m-class telescopes; (2) the planned Maunakea Spectroscopic Explorer, a dedicated 10m-class spectroscopic survey telescope with a 1.5 sq. deg field-of-view and multiplex of thousands of fibers in both optical and near-IR (J+H) to begin operations in 2029; (3) the Time-domain Spectroscopic Observatory (TSO), a proposed Probe-class ~1.3m telescope at L2, with imaging and spectroscopy (R=200, 1800) in 4 bands (0.3 - 5 micron) and rapid slew capability to 90% of sky, which will extend the coverage of Hbeta to z=8.

astro-ph.GA↗

arXiv2019

Changing-Look Quasar Candidates: First Results from Follow-up Spectroscopy of Highly Optically Variable Quasars

Active galactic nuclei (AGN) that show strong rest-frame optical/UV variability in their blue continuum and broad line emission are classified as "changing-look" AGN, or at higher luminosities changing look quasars (CLQs). These surprisingly large and sometimes rapid transitions challenge accepted models of quasar physics and duty cycles, offer several new avenues for study of quasar host galaxies, and open a wider interpretation of the cause of differences between broad and narrow line AGN. To better characterize extreme quasar variability, we present follow-up spectroscopy as part of a comprehensive search for CLQs across the full SDSS footprint using spectroscopically confirmed quasars from the SDSS DR7 catalog. Our primary selection requires large-amplitude (|Δg|>1 mag, |Δr|>0.5 mag) variability over any of the available time baselines probed by the SDSS and Pan-STARRS 1 surveys. We employ photometry from the Catalina Sky Survey to verify variability behavior in CLQ candidates where available, and confirm CLQs using optical spectroscopy from the William Herschel, MMT, Magellan, and Palomar telescopes. For our adopted S/N threshold on variability of broad Hβemission, we find 17 new CLQs, yielding a confirmation rate of >~ 20%. These candidates are at lower Eddington ratio relative to the overall quasar population which supports a disk-wind model for the broad line region. Based on our sample, the CLQ fraction increases from 10% to roughly half as the continuum flux ratio between repeat spectra at 3420 Angstroms increases from 1.5 to 6. We release a catalog of over 200 highly variable candidates to facilitate future CLQ searches.

astro-ph.GA↗

arXiv2019

The Zwicky Transient Facility: Data Processing, Products, and Archive

The Zwicky Transient Facility (ZTF) is a new robotic time-domain survey currently in progress using the Palomar 48-inch Schmidt Telescope. ZTF uses a 47 square degree field with a 600 megapixel camera to scan the entire northern visible sky at rates of ~3760 square degrees/hour to median depths of g ~ 20.8 and r ~ 20.6 mag (AB, 5sigma in 30 sec). We describe the Science Data System that is housed at IPAC, Caltech. This comprises the data-processing pipelines, alert production system, data archive, and user interfaces for accessing and analyzing the products. The realtime pipeline employs a novel image-differencing algorithm, optimized for the detection of point source transient events. These events are vetted for reliability using a machine-learned classifier and combined with contextual information to generate data-rich alert packets. The packets become available for distribution typically within 13 minutes (95th percentile) of observation. Detected events are also linked to generate candidate moving-object tracks using a novel algorithm. Objects that move fast enough to streak in the individual exposures are also extracted and vetted. The reconstructed astrometric accuracy per science image with respect to Gaia is typically 45 to 85 milliarcsec. This is the RMS per axis on the sky for sources extracted with photometric S/N >= 10. The derived photometric precision (repeatability) at bright unsaturated fluxes varies between 8 and 25 millimag. Photometric calibration accuracy with respect to Pan-STARRS1 is generally better than 2%. The products support a broad range of scientific applications: fast and young supernovae, rare flux transients, variable stars, eclipsing binaries, variability from active galactic nuclei, counterparts to gravitational wave sources, a more complete census of Type Ia supernovae, and Solar System objects.

astro-ph.IM↗

arXiv2019

Machine Learning for the Zwicky Transient Facility

The Zwicky Transient Facility is a large optical survey in multiple filters producing hundreds of thousands of transient alerts per night. We describe here various machine learning (ML) implementations and plans to make the maximal use of the large data set by taking advantage of the temporal nature of the data, and further combining it with other data sets. We start with the initial steps of separating bogus candidates from real ones, separating stars and galaxies, and go on to the classification of real objects into various classes. Besides the usual methods (e.g., based on features extracted from light curves) we also describe early plans for alternate methods including the use of domain adaptation, and deep learning. In a similar fashion we describe efforts to detect fast moving asteroids. We also describe the use of the Zooniverse platform for helping with classifications through the creation of training samples, and active learning. Finally we mention the synergistic aspects of ZTF and LSST from the ML perspective.

astro-ph.IM↗

arXiv2019

Deep Learning for Multi-Messenger Astrophysics: A Gateway for Discovery in the Big Data Era

This report provides an overview of recent work that harnesses the Big Data Revolution and Large Scale Computing to address grand computational challenges in Multi-Messenger Astrophysics, with a particular emphasis on real-time discovery campaigns. Acknowledging the transdisciplinary nature of Multi-Messenger Astrophysics, this document has been prepared by members of the physics, astronomy, computer science, data science, software and cyberinfrastructure communities who attended the NSF-, DOE- and NVIDIA-funded "Deep Learning for Multi-Messenger Astrophysics: Real-time Discovery at Scale" workshop, hosted at the National Center for Supercomputing Applications, October 17-19, 2018. Highlights of this report include unanimous agreement that it is critical to accelerate the development and deployment of novel, signal-processing algorithms that use the synergy between artificial intelligence (AI) and high performance computing to maximize the potential for scientific discovery with Multi-Messenger Astrophysics. We discuss key aspects to realize this endeavor, namely (i) the design and exploitation of scalable and computationally efficient AI algorithms for Multi-Messenger Astrophysics; (ii) cyberinfrastructure requirements to numerically simulate astrophysical sources, and to process and interpret Multi-Messenger Astrophysics data; (iii) management of gravitational wave detections and triggers to enable electromagnetic and astro-particle follow-ups; (iv) a vision to harness future developments of machine and deep learning and cyberinfrastructure resources to cope with the scale of discovery in the Big Data Era; (v) and the need to build a community that brings domain experts together with data scientists on equal footing to maximize and accelerate discovery in the nascent field of Multi-Messenger Astrophysics.

astro-ph.IM↗

arXiv2018

A new physical interpretation of optical and infrared variability in quasars

Changing-look quasars are a recently identified class of active galaxies in which the strong UV continuum and/or broad optical hydrogen emission lines associated with unobscured quasars either appear or disappear on timescales of months to years. The physical processes responsible for this behaviour are still debated, but changes in the black hole accretion rate or accretion disk structure appear more likely than changes in obscuration. Here we report on four epochs of spectroscopy of SDSS J110057.70-005304.5, a quasar at a redshift of $z=0.378$ whose UV continuum and broad hydrogen emission lines have faded, and then returned over the past $\approx$20 years. The change in this quasar was initially identified in the infrared, and an archival spectrum from 2010 shows an intermediate phase of the transition during which the flux below rest-frame $\approx$3400Å has decreased by close to an order of magnitude. This combination is unique compared to previously published examples of changing-look quasars, and is best explained by dramatic changes in the innermost regions of the accretion disk. The optical continuum has been rising since mid-2016, leading to a prediction of a rise in hydrogen emission line flux in the next year. Increases in the infrared flux are beginning to follow, delayed by a $\sim$3 year observed timescale. If our model is confirmed, the physics of changing-look quasars are governed by processes at the innermost stable circular orbit (ISCO) around the black hole, and the structure of the innermost disk. The easily identifiable and monitored changing-look quasars would then provide a new probe and laboratory of the nuclear central engine.

astro-ph.GA↗

arXiv2018

Movie Moves for Knotted Surfaces with Markings

We present a marked analogue of Carter and Saito's movie theorem. Our definition of marking was chosen to coincide with the markings that arise in link Floer homology. In order to deal with complications arising from certain isotopies, we define three equivalence relations for marked surfaces and work over an equivalence class of marked surfaces when providing our generalization of Carter and Saito's movie theorem.

math.GT↗

arXiv2017

Solving the puzzle of discrepant quasar variability on monthly time-scales implied by SDSS and CRTS data sets

We present an improved photometric error analysis for the 7,100 CRTS (Catalina Real-Time Transient Survey) optical light curves for quasars from the SDSS (Sloan Digital Sky Survey) Stripe 82 catalogue. The SDSS imaging survey has provided a time-resolved photometric data set which greatly improved our understanding of the quasar optical continuum variability: Data for monthly and longer time-scales are consistent with a damped random walk (DRW). Recently, newer data obtained by CRTS provided puzzling evidence for enhanced variability, compared to SDSS results, on monthly time-scales. Quantitatively, SDSS results predict about 0.06 mag root-mean-square (rms) variability for monthly time-scales, while CRTS data show about a factor of 2 larger rms, for spectroscopically confirmed SDSS quasars. Our analysis has successfully resolved this discrepancy as due to slightly underestimated photometric uncertainties from the CRTS image processing pipelines. As a result, the correction for observational noise is too small and the implied quasar variability is too large. The CRTS photometric error correction factors, derived from detailed analysis of non-variable SDSS standard stars that were re-observed by CRTS, are about 20-30%, and result in reconciling quasar variability behaviour implied by the CRTS data with earlier SDSS results. An additional analysis based on independent light curve data for the same objects obtained by the Palomar Transient Factory provides further support for this conclusion. In summary, the quasar variability constraints on weekly and monthly time-scales from SDSS, CRTS and PTF surveys are mutually compatible, as well as consistent with DRW model.

astro-ph.GA↗

arXiv2017

Processing Images from the Zwicky Transient Facility

The Zwicky Transient Facility is a new robotic-observing program, in which a newly engineered 600-MP digital camera with a pioneeringly large field of view, 47~square degrees, will be installed into the 48-inch Samuel Oschin Telescope at the Palomar Observatory. The camera will generate $\sim 1$~petabyte of raw image data over three years of operations. In parallel related work, new hardware and software systems are being developed to process these data in real time and build a long-term archive for the processed products. The first public release of archived products is planned for early 2019, which will include processed images and astronomical-source catalogs of the northern sky in the $g$ and $r$ bands. Source catalogs based on two different methods will be generated for the archive: aperture photometry and point-spread-function fitting.

astro-ph.IM↗

arXiv2017

Deep-Learnt Classification of Light Curves

Astronomy light curves are sparse, gappy, and heteroscedastic. As a result standard time series methods regularly used for financial and similar datasets are of little help and astronomers are usually left to their own instruments and techniques to classify light curves. A common approach is to derive statistical features from the time series and to use machine learning methods, generally supervised, to separate objects into a few of the standard classes. In this work, we transform the time series to two-dimensional light curve representations in order to classify them using modern deep learning techniques. In particular, we show that convolutional neural networks based classifiers work well for broad characterization and classification. We use labeled datasets of periodic variables from CRTS survey and show how this opens doors for a quick classification of diverse classes with several possible exciting extensions.

astro-ph.IM↗

arXiv2016

Dark Sectors 2016 Workshop: Community Report

This report, based on the Dark Sectors workshop at SLAC in April 2016, summarizes the scientific importance of searches for dark sector dark matter and forces at masses beneath the weak-scale, the status of this broad international field, the important milestones motivating future exploration, and promising experimental opportunities to reach these milestones over the next 5-10 years.

hep-ph↗

arXiv2015

IVOA recommendation: VOSpace specification v2.0

VOSpace is the IVOA interface to distributed storage. This specification presents the first RESTful version of the interface, which is functionally equivalent to the SOAP-based VOSpace 1.1 specification. Note that all prior VOSpace clients will not work with this new version of the interface.

astro-ph.IM↗

arXiv2014

Immersive and Collaborative Data Visualization Using Virtual Reality Platforms

Effective data visualization is a key part of the discovery process in the era of big data. It is the bridge between the quantitative content of the data and human intuition, and thus an essential component of the scientific path from data into knowledge and understanding. Visualization is also essential in the data mining process, directing the choice of the applicable algorithms, and in helping to identify and remove bad data from the analysis. However, a high complexity or a high dimensionality of modern data sets represents a critical obstacle. How do we visualize interesting structures and patterns that may exist in hyper-dimensional data spaces? A better understanding of how we can perceive and interact with multi dimensional information poses some deep questions in the field of cognition technology and human computer interaction. To this effect, we are exploring the use of immersive virtual reality platforms for scientific data visualization, both as software and inexpensive commodity hardware. These potentially powerful and innovative tools for multi dimensional data visualization can also provide an easy and natural path to a collaborative data visualization and exploration, where scientists can interact with their data and their colleagues in the same visual space. Immersion provides benefits beyond the traditional desktop visualization tools: it leads to a demonstrably better perception of a datascape geometry, more intuitive data understanding, and a better retention of the perceived relationships in the data.

cs.HC↗

arXiv2014

Grid Movies

We present a grid diagram analogue of Carter, Rieger and Saito's smooth movie theorem. Specifically, we give definitions for grid movies, grid movie isotopies and present a definition of grid planar isotopy as a particular subset of the grid diagram moves: stabilization, destabilization and commutation. We show that grid planar isotopy classes are in 1-1 correspondence with smooth planar isotopy classes by using a new planar grid algorithm that takes a smooth knot diagram to a grid diagram. We then present generalizations of both the smooth and grid movie theorems that apply to surfaces with boundary.

math.GT↗