Search arXivSearch

arXiv subjects

Patrick Hall

Publications and source records attributed to Patrick Hall.

At least 19 recordsLinked to original sources

Branching Out: Broadening AI Measurement and Evaluation with Measurement Trees

This paper introduces \textit{measurement trees}, a novel class of metrics designed to combine various constructs into an interpretable multi-level representation of a measurand. Unlike conventional metrics that yield single values, vectors, surfaces, or categories, measurement trees produce a hierarchical directed graph in which each node summarizes its children through user-defined aggregation methods. In response to recent calls to expand the scope of AI system evaluation, measurement trees enhance metric transparency and facilitate the integration of heterogeneous evidence, including, e.g., agentic, business, energy-efficiency, sociotechnical, or security signals. We present definitions and examples, demonstrate practical utility through a large-scale measurement exercise, and provide accompanying open-source Python code. By operationalizing a transparent approach to measurement of complex constructs, this work offers a principled foundation for broader and more interpretable AI evaluation.

cs.AI

Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects

Conventional AI evaluation approaches concentrated within the AI stack exhibit systemic limitations for exploring, navigating and resolving the human and societal factors that play out in real world deployment such as in education, finance, healthcare, and employment sectors. AI capability evaluations can capture detail about first-order effects, such as whether immediate system outputs are accurate, or contain toxic, biased or stereotypical content, but AI's second-order effects, i.e. any long-term outcomes and consequences that may result from AI use in the real world, have become a significant area of interest as the technology becomes embedded in our daily lives. These secondary effects can include shifts in user behavior, societal, cultural and economic ramifications, workforce transformations, and long-term downstream impacts that may result from a broad and growing set of risks. This position paper argues that measuring the indirect and secondary effects of AI will require expansion beyond static, single-turn approaches conducted in silico to include testing paradigms that can capture what actually materializes when people use AI technology in context. Specifically, we describe the need for data and methods that can facilitate contextual awareness and enable downstream interpretation and decision making about AI's secondary effects, and recommend requirements for a new ecosystem.

cs.CY

Revisiting Emission-Line Measurement Methods for Narrow-Line Active Galactic Nuclei

Measuring broad emission-line widths in active galactic nuclei (AGN) is not straightforward owing to the complex nature of flux variability in these systems. Line-width measurements become especially challenging when signal-to-noise is low, profiles are narrower, or spectral resolution is low. We conducted an extensive correlation analysis between emission-line measurements from the optical spectra of Markarian 142 (Mrk 142; a narrow-line Seyfert galaxy) taken with the Gemini North Telescope (Gemini) at a spectral resolution of 185.6+\-10.2 km/s and the Lijiang Telescope (LJT) at 695.2+\-3.9 km/s to investigate the disparities in the measured broad-line widths from both telescope data. Mrk~142 posed a challenge due to its narrow broad-line profiles, which were severely affected by instrumental broadening in the lower-resolution LJT spectra. We discovered that allowing the narrow-line flux of permitted lines having broad and narrow components to vary during spectral fitting caused a leak in the narrow-line flux to the broad component, resulting in broader broad-line widths in the LJT spectra. Fixing the narrow-line flux ratios constrained the flux leak and yielded the Hydrogen-beta broad-line widths from LJT spectra $\sim$54\% closer to the Gemini Hydrogen-beta widths than with flexible narrow-line ratios. The availability of spectra at different resolutions presented this unique opportunity to inspect how spectral resolution affected emission-line profiles in our data and adopt a unique method to accurately measure broad-line widths. Reconsidering line-measurement methods while studying diverse AGN populations is critical for the success of future reverberation-mapping studies. Based on the technique used in this work, we offer recommendations for measuring line widths in narrow-line AGN.

astro-ph.GA

The Eighteenth Data Release of the Sloan Digital Sky Surveys: Targeting and First Spectra from SDSS-V

The eighteenth data release of the Sloan Digital Sky Surveys (SDSS) is the first one for SDSS-V, the fifth generation of the survey. SDSS-V comprises three primary scientific programs, or "Mappers": Milky Way Mapper (MWM), Black Hole Mapper (BHM), and Local Volume Mapper (LVM). This data release contains extensive targeting information for the two multi-object spectroscopy programs (MWM and BHM), including input catalogs and selection functions for their numerous scientific objectives. We describe the production of the targeting databases and their calibration- and scientifically-focused components. DR18 also includes ~25,000 new SDSS spectra and supplemental information for X-ray sources identified by eROSITA in its eFEDS field. We present updates to some of the SDSS software pipelines and preview changes anticipated for DR19. We also describe three value-added catalogs (VACs) based on SDSS-IV data that have been published since DR17, and one VAC based on the SDSS-V data in the eFEDS field.

astro-ph.GA

Proposed Guidelines for the Responsible Use of Explainable Machine Learning

Explainable machine learning (ML) enables human learning from ML, human appeal of automated model decisions, regulatory compliance, and security audits of ML models. Explainable ML (i.e. explainable artificial intelligence or XAI) has been implemented in numerous open source and commercial packages and explainable ML is also an important, mandatory, or embedded aspect of commercial predictive modeling in industries like financial services. However, like many technologies, explainable ML can be misused, particularly as a faulty safeguard for harmful black-boxes, e.g. fairwashing or scaffolding, and for other malevolent purposes like stealing models and sensitive training data. To promote best-practice discussions for this already in-flight technology, this short text presents internal definitions and a few examples before covering the proposed guidelines. This text concludes with a seemingly natural argument for the use of interpretable models and explanatory, debugging, and disparate impact testing methods in life- or mission-critical ML systems.

stat.ML

The Detailed Science Case for the Maunakea Spectroscopic Explorer, 2019 edition

(Abridged) The Maunakea Spectroscopic Explorer (MSE) is an end-to-end science platform for the design, execution and scientific exploitation of spectroscopic surveys. It will unveil the composition and dynamics of the faint Universe and impact nearly every field of astrophysics across all spatial scales, from individual stars to the largest scale structures in the Universe. Major pillars in the science program for MSE include (i) the ultimate Gaia follow-up facility for understanding the chemistry and dynamics of the distant Milky Way, including the outer disk and faint stellar halo at high spectral resolution (ii) galaxy formation and evolution at cosmic noon, via the type of revolutionary surveys that have occurred in the nearby Universe, but now conducted at the peak of the star formation history of the Universe (iii) derivation of the mass of the neutrino and insights into inflationary physics through a cosmological redshift survey that probes a large volume of the Universe with a high galaxy density. MSE is positioned to become a critical hub in the emerging international network of front-line astronomical facilities, with scientific capabilities that naturally complement and extend the scientific power of Gaia, the Large Synoptic Survey Telescope, the Square Kilometer Array, Euclid, WFIRST, the 30m telescopes and many more.

astro-ph.IM

The Maunakea Spectroscopic Explorer Book 2018

(Abridged) This is the Maunakea Spectroscopic Explorer 2018 book. It is intended as a concise reference guide to all aspects of the scientific and technical design of MSE, for the international astronomy and engineering communities, and related agencies. The current version is a status report of MSE's science goals and their practical implementation, following the System Conceptual Design Review, held in January 2018. MSE is a planned 10-m class, wide-field, optical and near-infrared facility, designed to enable transformative science, while filling a critical missing gap in the emerging international network of large-scale astronomical facilities. MSE is completely dedicated to multi-object spectroscopy of samples of between thousands and millions of astrophysical objects. It will lead the world in this arena, due to its unique design capabilities: it will boast a large (11.25 m) aperture and wide (1.52 sq. degree) field of view; it will have the capabilities to observe at a wide range of spectral resolutions, from R2500 to R40,000, with massive multiplexing (4332 spectra per exposure, with all spectral resolutions available at all times), and an on-target observing efficiency of more than 80%. MSE will unveil the composition and dynamics of the faint Universe and is designed to excel at precision studies of faint astrophysical phenomena. It will also provide critical follow-up for multi-wavelength imaging surveys, such as those of the Large Synoptic Survey Telescope, Gaia, Euclid, the Wide Field Infrared Survey Telescope, the Square Kilometre Array, and the Next Generation Very Large Array.

astro-ph.IM

On the Art and Science of Machine Learning Explanations

This text discusses several popular explanatory methods that go beyond the error measurements and plots traditionally used to assess machine learning models. Some of the explanatory methods are accepted tools of the trade while others are rigorously derived and backed by long-standing theory. The methods, decision tree surrogate models, individual conditional expectation (ICE) plots, local interpretable model-agnostic explanations (LIME), partial dependence plots, and Shapley explanations, vary in terms of scope, fidelity, and suitable application domain. Along with descriptions of these methods, this text presents real-world usage recommendations supported by a use case and public, in-depth software examples for reproducibility.

stat.ML

Optimal scheduling and science delivery of spectra for millions of targets in thousands of fields: the operational concept of the Maunakea spectroscopic explorer (MSE)

The Maunakea Spectroscopic Explorer (MSE) will each year obtain millions of spectra in the optical to near-infrared, at low (R~3000) to high (R~40000) spectral resolution by observing >3000 spectra per pointing via a highly multiplexed fiber-fed system. Key science programs for MSE include black hole reverberation mapping, stellar population analysis of faint galaxies at high redshift, and sub-km/s velocity accuracy for stellar astrophysics. The architecture of MSE is an assembly of subsystems designed to meet the science requirements and describes what MSE will look like. In this paper we focus on the operations concept of MSE, which describes how to operate a fiber fed, highly multiplexed, dedicated observatory given its architecture and the science requirements. The operations concept details the phases of operations, from selecting proposals within the science community to distributing back millions of spectra to this community. For each phase, the operations concept describes the tools required to support the science community in their analyses and the operations staff in their work. It also highlights the specific needs related to the complexity of MSE with millions of targets to observe, thousands of fibers to position, and different spectral resolution to use. Finally, the operations concept shows how the science requirements on calibration and observing efficiency can be met.

astro-ph.IM

Automated testing of optical fibres: towards the design of the Maunakea Spectroscopic Explorer Fibre Transmission System

We present the results of an automated fibre optic test bench constructed at the University of Victoria as part of the Maunakea Spectroscopic Explorer (MSE) Fibre Transmission System (FiTS). In preparation for MSE-FiTS, we have begun characterizing the focal ratio degradation (FRD) of candidate multi-mode fibres with the ultimate goal of testing all ~4000 MSE fibres. To achieve this, we have built an optical bench to perform an automated version of the collimated beam test. Herein we present the design of the bench and discuss the automation of components by introducing the Big FiTS Fibre Wrapper (Big FFW), our open-source automation software. We conclude with the results of tests performed using the Big FFW on a sample of candidate fibre, comparing the Big FFW results against those found using manual methods. Our results suggest that the candidate MSE fibre meets the science requirement of < 5% FRD at f=2 and less than 1% disagreement between both measurement methods.

astro-ph.IM

A Highly Accelerated Parallel Multi-GPU based Reconstruction Algorithm for Generating Accurate Relative Stopping Powers

Low-dose Proton Computed Tomography (pCT) is an evolving imaging modality that is used in proton therapy planning which addresses the range uncertainty problem. The goal of pCT is generating a 3D map of Relative Stopping Power (RSP) measurements with high accuracy within clinically required time frames. Generating accurate RSP values within the shortest amount of time is considered a key goal when developing a pCT software. The existing pCT softwares have successfully met this time frame and even succeeded this time goal, but requiring clusters with hundreds of processors. This paper describes a novel reconstruction technique using two Graphics Processing Unit (GPU) cores, such as is available on a single Nvidia P100. The proposed reconstruction technique is tested on both simulated and experimental datasets and on two different systems namely Nvidia K40 and P100 GPUs from IBM and Cray. The experimental results demonstrate that our proposed reconstruction method meets both the timing and accuracy with the benefit of having reasonable cost, and efficient use of power.

physics.med-ph

Non-Blackbody Disks Can Help Explain Inferred AGN Accretion Disk Sizes

If the atmospheric density $\rho_{atm}$ in the accretion disk of an active galactic nucleus (AGN) is sufficiently low, scattering in the atmosphere can produce a non-blackbody emergent spectrum. For a given bolometric luminosity, at ultraviolet and optical wavelengths such disks have lower fluxes and apparently larger sizes as compared to disks that emit as blackbodies. We show that models in which $\rho_{\rm atm}$ is a sufficiently low fixed fraction of the interior density $\rho$ can match the AGN STORM observations of NGC 5548 but produce disk spectral energy distributions that peak at shorter wavelengths than observed in luminous AGN in general. Thus, scattering atmospheres can contribute to the explanation for large inferred AGN accretion disk sizes but are unlikely to be the only contributor. In the appendix section, we present unified equations for the interior $\rho$ and $T$ in gas pressure-dominated regions of a thin accretion disk.

astro-ph.GA

The Astropy Problem

The Astropy Project (http://astropy.org) is, in its own words, "a community effort to develop a single core package for Astronomy in Python and foster interoperability between Python astronomy packages." For five years this project has been managed, written, and operated as a grassroots, self-organized, almost entirely volunteer effort while the software is used by the majority of the astronomical community. Despite this, the project has always been and remains to this day effectively unfunded. Further, contributors receive little or no formal recognition for creating and supporting what is now critical software. This paper explores the problem in detail, outlines possible solutions to correct this, and presents a few suggestions on how to address the sustainability of general purpose astronomical software.

astro-ph.IM

The Detailed Science Case for the Maunakea Spectroscopic Explorer: the Composition and Dynamics of the Faint Universe

MSE is an 11.25m aperture observatory with a 1.5 square degree field of view that will be fully dedicated to multi-object spectroscopy. More than 3200 fibres will feed spectrographs operating at low (R ~ 2000 - 3500) and moderate (R ~ 6000) spectral resolution, and approximately 1000 fibers will feed spectrographs operating at high (R ~ 40000) resolution. MSE is designed to enable transformational science in areas as diverse as tomographic mapping of the interstellar and intergalactic media; the in-situ chemical tagging of thick disk and halo stars; connecting galaxies to their large scale structure; measuring the mass functions of cold dark matter sub-halos in galaxy and cluster-scale hosts; reverberation mapping of supermassive black holes in quasars; next generation cosmological surveys using redshift space distortions and peculiar velocities. MSE is an essential follow-up facility to current and next generations of multi-wavelength imaging surveys, including LSST, Gaia, Euclid, WFIRST, PLATO, and the SKA, and is designed to complement and go beyond the science goals of other planned and current spectroscopic capabilities like VISTA/4MOST, WHT/WEAVE, AAT/HERMES and Subaru/PFS. It is an ideal feeder facility for E-ELT, TMT and GMT, and provides the missing link between wide field imaging and small field precision astronomy. MSE is optimized for high throughput, high signal-to-noise observations of the faintest sources in the Universe with high quality calibration and stability being ensured through the dedicated operational mode of the observatory. (abridged)

astro-ph.IM

Simulating the Phases of the Moon Shortly After Its Formation

The leading theory for the origin of the Moon is the giant impact hypothesis, in which the Moon was formed out of the debris left over from the collision of a Mars-sized body with the Earth. Soon after its formation, the orbit of the Moon may have been very different than it is today. We have simulated the phases of the Moon in a model for its formation wherein the Moon develops a highly elliptical orbit with its major axis tangential to the Earth's orbit. This note describes these simulations and their pedagogical value.

physics.pop-ph

The Extreme High-Velocity Outflow in Quasar PG0935+417

We report the detection of OVI 1031,1037 and NV 1238,1242 absorption in a system of "mini-broad" absorption lines (mini-BALs) previously reported to have variable CIV 1548,1550 in the quasar PG0935+417. The formation of these lines in an extreme high-velocity quasar outflow (with v ~ -50000 km/s) is confirmed by the line variability, broad smooth absorption profiles, and partial covering of the background light source. HI and lower ionization metals are not clearly present. The resolved OVI doublet indicates that these lines are moderately saturated, with the absorber covering ~80% of the quasar continuum source (C_f~0.8). We derive ionic column densities of order 1015 cm^(-2) in CIV and several times larger in OVI, indicating an ionization parameter of log U >~ -0.5. Assuming solar abundances, we estimate a total column density of N(H) ~5 x 10^(19) cm^(-2). This outflow emerged sometime between 1982 and 1993. Our examination of the CIV data from 1993 to 2007 shows that there is variable complex absorption across a range of velocities from -45000 to -54000 km/s. There is no clear evidence for acceleration or deceleration of the outflow gas. Outflows are common in Active Galactic Nuclei (AGN), but extreme speeds such as those reported here are extremely rare. It is not clear what properties of PG0935+417 might produce this unusual outflow. In fact, PG0935+417 has significantly less X-ray absorption than typical BAL quasars even though its outflow has a degree of ionization typical of BALs at speeds that are 2-3 times larger than most BALs. These results might present a challenge to theoretical models that invoke strong radiative shielding in the X-rays/far-UV to moderate the outflow ionization and thus enable its radiative acceleration to high speeds.

astro-ph.CO

Galaxy Evolution in Three dimensions : Time, Space and Mass

There are three major axes to describe the evolution of galaxies, namely, time (redshift), space (environment) and mass (stellar mass). In this article, one topic each will be presented along these axes. (1) Based on the Subaru wide-field (30') optical imaging of two distant clusters (z=0.55 and 0.83), we show the large scale structures in galaxy distributions on a scale greater than 10Mpc, which serve as an evidence for hierarchical growth of rich clusters of galaxies through assembly of surrounding groups. (2) Based on the deep NIR imaging of high-z clusters at z~1 and 1.5, we show massive galaxies in clusters have assembled most of their mass by z=1.5, which is earlier than the hierarchical model predictions. (3) Based on the Subaru deep and wide optical imaging of Subaru/XMM-Newton Deep Survey Field, we show a deficit of red and faint galaxies and a lack of blue massive galaxies in the high density regions at z~1, which suggest down-sizing in galaxy formation as apparently opposed to the CDM-based bottom-up scenario.

astro-ph

The Host Galaxies of AGN

We examine the properties of the host galaxies of 22,623 narrow-line AGN with 0.02<z<0.3 selected from a complete sample of 122,808 galaxies from the Sloan Digital Sky Survey. We focus on the luminosity of the [OIII]$λ$5007 emission line as a tracer of the strength of activity in the nucleus. We study how AGN host properties compare to those of normal galaxies and how they depend on L[OIII]. We find that AGN of all luminosities reside almost exclusively in massive galaxies and have distributions of sizes, stellar surface mass densities and concentrations that are similar to those of ordinary early-type galaxies in our sample. The host galaxies of low-luminosity AGN have stellar populations similar to normal early-types. The hosts of high- luminosity AGN have much younger mean stellar ages. The young stars are not preferentially located near the nucleus of the galaxy, but are spread out over scales of at least several kiloparsecs. A significant fraction of high- luminosity AGN have strong H$δ$ absorption-line equivalent widths, indicating that they experienced a burst of star formation in the recent past. We have also examined the stellar populations of the host galaxies of a sample of broad-line AGN. We conclude that there is no significant difference in stellar content between type 2 Seyfert hosts and QSOs with the same [OIII] luminosity and redshift. This establishes that a young stellar population is a general property of AGN with high [OIII] luminosities.

astro-ph