Search arXivSearch

arXiv subjects

Benjamin Horowitz

Publications and source records attributed to Benjamin Horowitz.

At least 19 recordsLinked to original sources

Fast(er)PM and Moving Mesh: JAX-native Geometric Multigrid Methods

Efficient, differentiable Poisson solvers are a key component of modern particle--mesh simulations and field-level inference pipelines. FFT-based solvers are extremely effective on fixed Cartesian meshes, but they impose global all-to-all communication and rely on symmetries that are lost in adaptive or non-Cartesian coordinates. In this work, we present a JAX-native geometric multigrid framework for particle--mesh gravity and argue that multigrid plays two complementary roles: on fixed meshes it can be a competitive, communication-avoiding alternative to FFTs, while on moving meshes it becomes the enabling solver. For static FastPM evolution, warm-started Chebyshev multigrid acts as a defect-correction method, exploiting temporal coherence between time steps to reduce the number of V-cycles required for field-level accuracy. At large mesh sizes this reduces memory pressure and yields comparable or faster wall-clock performance than distributed FFTs, with up to a factor of two reduction in total GPU time at fixed final mesh size. We then embed the same solver in a differentiable moving-mesh particle--mesh method, where adaptive coordinate deformation produces a variable-coefficient curvilinear Poisson equation that cannot be solved by ordinary FFT diagonalization. The resulting method concentrates force resolution in nonlinear structures while retaining a regular, JAX-compilable, automatically differentiable array workflow. These results suggest geometric multigrid can be a practical bridge between fast fixed-grid PM methods and differentiable adaptive-force cosmological simulations.

astro-ph.IM

Mujic{\Lambda}: Reconstructing Initial Conditions from Incomplete Redshift Surveys with Projected Optimization

In this paper, we introduce Mujic{\Lambda} (Mapping the Universe with Jax-based Initial Condition Reconstr{\Lambda}ction), an optimization-based framework for reconstructing initial conditions from realistic galaxy spectroscopic redshift surveys. Unlike standard optimization-based approaches, Mujic{\Lambda} augments the L-BFGS algorithm with a projection operator and rank-order matching to enforce Gaussianity of the initial conditions and substantially improve robustness to incomplete survey geometries. We validate Mujic{\Lambda} on a mock lightcone catalog derived from semi-analytic models applied to the Millennium simulation. We construct a differentiable forward model that incorporates a fast particle-mesh simulation at megaparsec resolution and a comprehensive treatment of observational effects and survey incompleteness. Mujic{\Lambda} reaches good agreement with the true density field down to the scale of the forward model, while maintaining consistency with the Gaussian prior through the projection step. It also broadly recovers the cosmic web classification, underscoring its value for deciphering environmental information in galaxy evolution studies. Beyond its key role in next-generation constrained simulations, the methodology offers a practical way to generate initial guesses and speed up field-level inference, especially for upcoming large-scale galaxy surveys.

astro-ph.CO

Generalized Hyperderivative Reed-Solomon Codes

This article introduces Generalized Hyperderivative Reed-Solomon codes (GHRS codes), which generalize NRT Reed-Solomon codes. Its main results are as follows: 1) every GHRS code is MDS, 2) the dual of a GHRS code is also an GHRS code, 3) determine subfamilies of GHRS codes whose members are low-density parity-check codes (LDPCs), and 4) determine a family of GHRS codes whose members are quasi-cyclic. We point out that there are GHRS codes having all of these properties.

cs.IT

diffhydro: Inverse Multiphysics Modeling and Embedded Machine Learning in Astrophysical Flows

We present the extension of the differentiable hydrodynamics code, diffhydro, enabling scalable PDE-constrained inference and integrated hybrid physics-ML models for a wide range of astrophysical applications. New physics additions include radiative heating/cooling, OU-driven turbulence, and self-gravity via multigrid Poisson. We demonstrate good agreement with the Athena++ code on standard validation tests such as Sedov-Taylor, Kelvin-Helmholtz, and driven/decaying turbulence. We further introduce a solver-in-the-loop neural corrector that reduces coarse-grid errors during time integration while preserving stability. The addition of custom adjoints facilitates efficient end-to-end gradients and multi-device scaling. We present simulations up to 1024^3 elements, run on distributed GPU systems, and we show gradient-based reconstructions of complex initial conditions in turbulent, self-gravitating, radiatively cooling flows. The code is written in JAX, and the solver's modular finite-volume components are compiled by XLA into fused accelerator kernels, delivering high-throughput forward runs and tractable differentiation through long integrations.

astro-ph.IM

jFoF: GPU Cluster Finding with Gradient Propagation

We present jFoF, a fully GPU-native Friends-of-Friends (FoF) halo finder designed for both high-performance simulation analysis and differentiable modeling. Implemented in JAX, jFoF achieves end-to-end acceleration by performing all neighbor searches, label propagation, and group construction directly on GPUs, eliminating costly host--device transfers. We introduce two complementary neighbor-search strategies, a standard k-d tree and a novel linked-cell grid, and demonstrate that jFoF attains up to an order-of-magnitude speedup compared to optimized CPU implementations while maintaining consistent halo catalogs. Beyond performance, jFoF enables gradient propagation through discrete halo-finding operations via both frozen-assignment and topological optimization modes. Using a topological optimization approach via a REINFORCE-style estimator, our approach allows smooth optimization of halo connectivity and membership, bridging continuous simulation fields with discrete structure catalogs. These capabilities make jFoF a foundation for differentiable inference, enabling end-to-end, gradient-based optimization of structure formation models within GPU-accelerated astrophysical pipelines. We make our code publicly available at https://github.com/bhorowitz/jFOF/.

astro-ph.IM

BaryonBridge: Stochastic Interpolant Model for Fast Hydrodynamical Simulations

Constructing a general-purpose framework for mapping between dark matter simulations and observable hydrodynamical simulation outputs is a long-standing problem in modern astrophysics. In this work, we present a new approach utilizing stochastic interpolants to map between cheap fast particle mesh simulations and baryonic quantities in three dimensions, requiring a total of 7 GPU minutes per 256^3 grid size simulation. Using the CAMELS multifield dataset, we are able to condition our mapping on both cosmological and astrophysical properties. We focus this work on hydrodynamical quantities suitable for Lya observables finding excellent agreement up to small spatial scales, k ~ 10.0 (h^(-1) Mpc) at z=2.0, for Lya flux statistics. Our approach is fully convolutional, allowing training on comparatively small volumes and application to larger volumes, which was tested on TNG50.

astro-ph.CO

Differentiable Cosmological Hydrodynamics for Field-Level Inference and High Dimensional Parameter Constraints

Hydrodynamical simulations are the most accurate way to model structure formation in the universe, but they often involve a large number of astrophysical parameters modeling subgrid physics, in addition to cosmological parameters. This results in a high-dimensional space that is difficult to jointly constrain using traditional statistical methods due to prohibitive computational costs. To address this, we present a fully differentiable approach for cosmological hydrodynamical simulations and a proof-of-concept implementation, diffhydro. By back-propagating through an upwind finite volume scheme for solving the Euler Equations jointly with a dark matter particle-mesh method for Poisson equation, we are able to efficiently evaluate derivatives of the output baryonic fields with respect to input density and model parameters. Importantly, we demonstrate how to differentiate through stochastically sampled discrete random variables, which frequently appear in subgrid models. We use this framework to rapidly sample sub-grid physics and cosmological parameters as well as perform field level inference of initial conditions using high dimensional optimization techniques. Our code is implemented in JAX (python), allowing easy code development and GPU acceleration.

astro-ph.CO

Introducing cosmosTNG: simulating galaxy formation with constrained realizations of the COSMOS field

We introduce the new cosmological simulation project cosmosTNG, a first-of-its-kind suite of constrained galaxy formation simulations for the universe at Cosmic Noon ($z\sim 2$). cosmosTNG simulates a $0.2$ deg$^2$ patch of the COSMOS field at $z \simeq 2.0-2.2$ using an initial density field inferred from galaxy redshift surveys and the CLAMATO Lyman-alpha forest tomography survey, reconstructed by the TARDIS algorithm. We evolve eight different realizations of this volume to capture small-scale variations. All runs use the IllustrisTNG galaxy formation model with a baryonic mass resolution of $10^6$ M$_\odot$, equal to TNG100-1. In this initial study, we demonstrate qualitative agreement between the evolved large-scale structure and the spatial distribution of observed galaxy populations in COSMOS, emphasizing the zFIRE protocluster region. We then compare the statistical properties and scaling relations of the galaxy population, covering stellar, gaseous, and supermassive black hole (SMBH) components, between cosmosTNG, observations in COSMOS, and $z \sim 2$ observational data in general. We find that galaxy quenching and environmental effects in COSMOS are modulated by its specific large-scale structure, particularly the collapsing protoclusters in the region. With respect to a random region of the universe, the abundance of high-mass galaxies is larger, and the quenched fraction of galaxies is significant lower at fixed mass. This suggests an accelerated growth of stellar mass, as reflected in a higher cosmic star formation rate density, due to the unique assembly histories of galaxies in the simulated COSMOS subvolume. The cosmosTNG suite will be a valuable tool for studying galaxy formation at cosmic noon, particularly when interpreting extragalactic observations with HST, JWST, and other large multi-wavelength survey programs of the COSMOS field.

astro-ph.GA

TensorFlow Hydrodynamics Analysis for Ly-$\alpha$ Simulations

We introduce the Python program THALAS (TensorFlow Hydrodynamics Analysis for Lyman-Alpha Simulations), which maps baryon fields (baryon density, temperature, and velocity) to Ly$\alpha$ optical depth fields in both real space and redshift space. Unlike previous Ly$\alpha$ codes, THALAS is fully differentiable, enabling a wide variety of potential applications for general analysis of hydrodynamical simulations and cosmological inference. To demonstrate THALAS's capabilities, we apply it to the Ly$\alpha$ forest inversion problem: given a Ly$\alpha$ optical depth field, we reconstruct the corresponding real-space dark matter density field. Such applications are relevant to both cosmological and three-dimensional tomographic analyses of Lyman Alpha forest data.

astro-ph.CO

Maximum A Posteriori Ly-alpha Estimator (MAPLE): Band-power and covariance estimation of the 3D Ly-alpha forest power spectrum

We present a novel maximum a posteriori estimator to jointly estimate band-powers and the covariance of the three-dimensional power spectrum (P3D) of Lyman-alpha forest flux fluctuations, called MAPLE. Our Wiener-filter based algorithm reconstructs a window-deconvolved P3D in the presence of complex survey geometries typical for Lyman-alpha surveys that are sparsely sampled transverse to and densely sampled along the line-of-sight. We demonstrate our method on idealized Gaussian random fields with two selection functions: (i) a sparse sampling of 30 background sources per square degree designed to emulate the currently observing the Dark Energy Spectroscopic Instrument (DESI); (ii) a dense sampling of 900 background sources per square degree emulating the upcoming Prime Focus Spectrograph Galaxy Evolution Survey. Our proof-of-principle shows promise, especially since the algorithm can be extended to marginalize jointly over nuisance parameters and contaminants, i.e.offsets introduced by continuum fitting. Our code is implemented in JAX and is publicly available on GitHub.

astro-ph.CO

Joint Cosmic Density Reconstruction from Photometric and Spectroscopic Samples

We reconstruct the dark matter density field from spatially overlapping spectroscopic and photometric redshift catalogs through a forward modelling approach. Instead of directly inferring the underlying density field, we find the best fitting initial Gaussian fluctuations that will evolve into the observed cosmic volume. To account for the substantial uncertainty of photometric redshifts we employ a differentiable continuous Poisson process. In the context of the upcoming Prime Focus Spectrograph (PFS), we find improvements in cosmic structure classification equivalent to 50-100\% more spectroscopic targets by combining relatively sparse spectroscopic with dense photometric samples.

astro-ph.CO

NANCY: Next-generation All-sky Near-infrared Community surveY

The Nancy Grace Roman Space Telescope is capable of delivering an unprecedented all-sky, high-spatial resolution, multi-epoch infrared map to the astronomical community. This opportunity arises in the midst of numerous ground- and space-based surveys that will provide extensive spectroscopy and imaging together covering the entire sky (such as Rubin/LSST, Euclid, UNIONS, SPHEREx, DESI, SDSS-V, GALAH, 4MOST, WEAVE, MOONS, PFS, UVEX, NEO Surveyor, etc.). Roman can uniquely provide uniform high-spatial-resolution (~0.1 arcsec) imaging over the entire sky, vastly expanding the science reach and precision of all of these near-term and future surveys. This imaging will not only enhance other surveys, but also facilitate completely new science. By imaging the full sky over two epochs, Roman can measure the proper motions for stars across the entire Milky Way, probing 100 times fainter than Gaia out to the very edge of the Galaxy. Here, we propose NANCY: a completely public, all-sky survey that will create a high-value legacy dataset benefiting innumerable ongoing and forthcoming studies of the universe. NANCY is a pure expression of Roman's potential: it images the entire sky, at high spatial resolution, in a broad infrared bandpass that collects as many photons as possible. The majority of all ongoing astronomical surveys would benefit from incorporating observations of NANCY into their analyses, whether these surveys focus on nearby stars, the Milky Way, near-field cosmology, or the broader universe.

astro-ph.IM

Forecasting the power of Higher Order Weak Lensing Statistics with automatically differentiable simulations

We present the Differentiable Lensing Lightcone (DLL), a fully differentiable physical model designed for being used as a forward model in Bayesian inference algorithms requiring access to derivatives of lensing observables with respect to cosmological parameters. We extend the public FlowPM N-body code, a particle-mesh N-body solver, simulating lensing lightcones and implementing the Born approximation in the Tensorflow framework. Furthermore, DLL is aimed at achieving high accuracy with low computational costs. As such, it integrates a novel Hybrid Physical-Neural parameterisation able to compensate for the small-scale approximations resulting from particle-mesh schemes for cosmological N-body simulations. We validate our simulations in an LSST setting against high-resolution $\kappa$TNG simulations by comparing both the lensing angular power spectrum and multiscale peak counts. We demonstrate an ability to recover lensing $C_\ell$ up to a 10% accuracy at $\ell=1000$ for sources at redshift 1, with as few as $\sim 0.6$ particles per Mpc/h. As a first use case, we use this tool to investigate the relative constraining power of the angular power spectrum and peak counts statistic in an LSST setting. Such comparisons are typically very costly as they require a large number of simulations, and do not scale well with the increasing number of cosmological parameters. As opposed to forecasts based on finite differences, these statistics can be analytically differentiated with respect to cosmology, or any systematics included in the simulations at the same computational cost of the forward simulation. We find that the peak counts outperform the power spectrum on the cold dark matter parameter $\Omega_c$, on the amplitude of density fluctuations $\sigma_8$, and on the amplitude of the intrinsic alignment signal $A_{IA}$.

astro-ph.IM

Observational Evidence for Large-Scale Gas Heating in a Galaxy Protocluster at z=2.30

We report a $z=2.30$ galaxy protocluster (COSTCO-I) in the COSMOS field, where the Lyman-$\alpha$ forest as seen in the CLAMATO IGM tomography survey does not show significant absorption. This departs from the transmission-density relationship (often dubbed the fluctuating Gunn-Peterson approximation; FGPA) usually expected to hold at this epoch, which would lead one to predict strong Ly$\alpha$ absorption at the overdensity. For comparison, we generate mock Lyman-$\alpha$ forest maps by applying FGPA to constrained simulations of the COSMOS density field, and create mocks that incorporate the effects of finite sightline sampling, pixel noise, and Wiener filtering. Averaged over $r=15\,h^{-1}\,\mathrm{Mpc}$ around the protocluster, the observed Lyman-$\alpha$ forest is consistently more transparent in the real data than in the mocks, indicating a rejection of the null hypothesis that the gas in COSTCO-I follows FGPA ($p=0.0026$, or $2.79 \sigma$ significance). It suggests that the large-scale gas associated with COSTCO-I is being heated above the expectations of FGPA, which might be due to either large-scale AGN jet feedback or early gravitational shock heating. COSTCO-I is the first known large-scale region of the IGM that is observed to be transitioning from the optically-thin photoionized regime at Cosmic Noon, to eventually coalesce into an intra-cluster medium (ICM) by $z=0$. Future observations of similar structures will shed light on the growth of the ICM and allow constraints on AGN feedback mechanisms.

astro-ph.GA

The Dependence of Galaxy Properties on the Underlying 3D Matter Density Field at 2.0 < z < 2.5

We study the environmental effect of galaxy evolution as a function of the underlying 3D dark matter density for the first time at $z=2-2.5$, in which the underlying matter density is reconstructed from observed galaxies through dynamical forward modeling techniques. Utilizing this map, we investigate the dependence of the star formation activities and galaxy types (mergers, submillimeter galaxies, active galactic nuclei, and quiescent galaxies) on the matter overdensity $\Delta_\text{local}$ and stellar mass. For the first time, we are able to probe underdense regions ($\Delta_\text{local}<1$) in addition to overdensities. We find that star formation activity generally depends on the stellar mass, not the matter density. We also find evidence that: (1) an absence of mergers and submillimeter galaxies in higher-density regions but otherwise no trend across lower-density bins, (2) the increase of active galactic nuclei and quiescent galaxy prevalence as a function of matter density, and (3) the increase of all aforementioned categories with the stellar mass. These results indicate that stellar mass is the main driver of galaxy evolution at the cosmic noon. Our novel approach directly using reconstructed dark matter density maps demonstrates the new capability of the environmental effect studies in galaxy evolution at higher redshift.

astro-ph.GA

Plausible Adversarial Attacks on Direct Parameter Inference Models in Astrophysics

In this abstract we explore the possibility of introducing biases in physical parameter inference models from adversarial-type attacks. In particular, we inject small amplitude systematics into inputs to a mixture density networks tasked with inferring cosmological parameters from observed data. The systematics are constructed analogously to white-box adversarial attacks. We find that the analysis network can be tricked into spurious detection of new physics in cases where standard cosmological estimators would be insensitive. This calls into question the robustness of such networks and their utility for reliably detecting new physics.

astro-ph.CO

Alignments Between Galaxies and the Cosmic Web at $z \sim 1-2$ in the IllustrisTNG Simulations

Galaxy formation theories predict that galaxy shapes and angular momenta have non-random alignments with the cosmic web. This leads to so-called intrinsic alignment between pairs of galaxies, which is important to quantify as a nuisance parameter for weak lensing. We study galaxy-cosmic web alignment in the IllustrisTNG suite of hydrodynamical simulations at redshifts 1 and 2, finding that alignment trends are consistent with previous studies. However, we find that the magnitude of the spin alignment signal is $\sim 2.4 \times$ weaker than seen in previous studies of the Horizon-AGN simulation, suggesting that this signal may have significant dependence on subgrid physics. Based on IllustrisTNG, we then construct mock observational spectroscopic surveys that can probe shape-cosmic web alignment at $z \sim 1-2$, modeled on the low-$z$ galaxy redshift and IGM tomography surveys on the upcoming Subaru Prime Focus Spectrograph Galaxy Evolution (PFS GE) survey. However, even over box sizes of $L=205\,h^{-1}\,\mathrm{Mpc}$, we find that global anisotropies induce a sample variance in the 2D projected alignment signal that depend on the projected direction -- this induces significant errors in the observed alignment. We predict a $5.3\sigma$ detection of IllustrisTNG's shape alignment signal at $z \sim 1$ from Subaru PFS GE, although a detection would be challenging at $z \sim 2$. However, a rough rescaling of the relative alignment signal strengths between the TNG and HorizonAGN simulations suggests that PFS GE should be able to more easily constrain the latter's stronger signal.

astro-ph.CO

Differentiable Stochastic Halo Occupation Distribution

In this work, we demonstrate how differentiable stochastic sampling techniques developed in the context of deep Reinforcement Learning can be used to perform efficient parameter inference over stochastic, simulation-based, forward models. As a particular example, we focus on the problem of estimating parameters of Halo Occupancy Distribution (HOD) models which are used to connect galaxies with their dark matter halos. Using a combination of continuous relaxation and gradient parameterization techniques, we can obtain well-defined gradients with respect to HOD parameters through discrete galaxy catalogs realizations. Having access to these gradients allows us to leverage efficient sampling schemes, such as Hamiltonian Monte-Carlo, and greatly speed up parameter inference. We demonstrate our technique on a mock galaxy catalog generated from the Bolshoi simulation using the Zheng et al. 2007 HOD model and find near identical posteriors as standard Markov Chain Monte Carlo techniques with an increase of ~8x in convergence efficiency. Our differentiable HOD model also has broad applications in full forward model approaches to cosmic structure and cosmological analysis.

astro-ph.CO