Search arXiv⌕ Search

arXiv subjects

Benjamin Nachman

Publications and source records attributed to Benjamin Nachman.

At least 19 recordsLinked to original sources

FAIR Universe Weak Lensing ML Uncertainty Challenge: Dataset and Cosmological Inference Competition

Weak gravitational lensing is a powerful cosmological probe that enables direct mapping of the matter distribution and precise constraints on the fundamental parameters governing structure formation in the universe. In recent years, machine learning has shown strong potential for extracting cosmological information from weak-lensing data beyond traditional summary statistics. However, progress has been limited by the lack of standardized benchmarks that capture the complexity of the dataset, simulator imperfections, and various systematic biases encountered in realistic analyses. To address this gap, we present the FAIR Universe Weak Lensing Machine Learning Uncertainty Challenge, one of the NeurIPS 2025 competitions, as a benchmark dataset and evaluation study. Our dataset reflects realistic weak-lensing observations, incorporating multiple systematic biases, and thereby providing a controlled testbed for robust cosmological inference under uncertainties. We summarize the main methodological advances developed by the winners of our challenge, including data augmentation with conditional optimal transport, an AI-agent-driven approach for parameter inference, ensemble learning, Vision Transformer-based architectures, and physics-informed feature integration. By unifying the benchmark dataset and the winning solutions, this work provides a community resource for developing and evaluating machine learning methods for weak lensing cosmology and, more broadly, for scientific inference under systematic uncertainties.

astro-ph.CO↗

Foundation model for particle collision data analysis

Data-intensive collider experiments increasingly require models that transfer across high-dimensional, partially observed measurements, yet most analyses still optimize separate models for each task. Here, to address this bottleneck, we introduce EVENET, an event-level foundation model pretrained on 500 million simulated collision events using self-supervised learning and physics-informed supervision. The model constructs a shared particle-cloud representation from the variable-length set of physics objects in each event. Across searches for heavy resonances and exotic Higgs decays, EVENET outperforms both established and state-of-the-art baselines, particularly in low-statistics regimes. We validate transfer to experimental data by rediscovering the $Υ$ meson in CMS Open Data. The pretrained model also supports precise extraction of quantum-correlation observables that remain stable under the tested systematic variations. Together, these results establish a reusable backbone for diverse collider analyses, improving downstream adaptation after a substantial one-time pretraining investment.

hep-ex↗

Towards anomaly detection searches for new physics signatures including Higgs bosons with weakly supervised machine learning

The Higgs boson, with its universal coupling to mass, provides a broadly applicable portal to sectors beyond the Standard Model and is therefore a natural anchor for anomaly detection (AD) at collider experiments. The Higgs And X Anomaly Detection (HAXAD) strategy offers a principled approach to searching for such anomalies occurring in association with a Higgs boson by combining machine-learning-based feature embedding, background estimation, and weakly supervised classification. This work extends the previous HAXAD approach towards the level of maturity required for application to recorded collider data. A major addition is the introduction and comparison of two new embedding strategies, which in turn shape the background estimation and classification. In addition, a new inference framework is developed, yielding signal-agnostic and signal-specific cross section limits and thereby completing the statistical machinery needed for future AD analyses built on HAXAD. The set of investigated signal models is also significantly expanded, allowing for the evaluation of sensitivity on a much broader phase space. Improvements to the method increase signal sensitivity with respect to the original method, and when benchmarked against an example cut-based search on the same final state, HAXAD matches or exceeds the best individual cut-based limits for a wide variety of considered signal models. These developments strengthen the case for HAXAD as a viable and compelling AD-based search strategy with novel discovery potential at colliders.

hep-ex↗

Blueprint for an AI-Enabled Particle Theory Community

Rapid advances in the capabilities and reach of artificial intelligence (AI) are changing research in particle physics. In this new era, AI is an innovative tool for theoretical physicists, while the interaction of AI and particle theory is itself a developing field. We argue that particle theory requires a community-scale effort to realize its full potential. We show how particle theory occupies a unique position in the AI for physics landscape, and describe the complementarity of AI and theory developments. We conclude with a series of recommendations on how to build an AI-enabled theory community for the Genesis Mission.

hep-ph↗

Parnassus for the CLD Detector: A Generative Machine-Learning Surrogate for Detector Simulation and Reconstruction at the FCC-ee

Detector simulation and event reconstruction will be computationally expensive for future $e^+e^-$ collider programs and are currently critical bottlenecks for accurate feasibility studies. To address this challenge, we build a Parnassus model for the CLD detector concept. Parnassus is a framework for automatically tuning a surrogate model, in our case, a conditional flow matching neural network, to emulate a full detector simulation and reconstruction. We train on $e^+e^-\to Z\to q\bar q$ events at $\sqrt{s}=91.2$ GeV processed through a Geant4 simulation of the CLD detector concept and the Pandora particle-flow reconstruction and reproduce single-particle kinematics, particle-IDs, and impact-parameter distributions. We also examine jet- and event-level features, inclusively and split by flavor, and find excellent fidelity, significantly better than the parameterized program Delphes. Furthermore, we train a transformer-based flavor tagger on the reconstructed particle-flow constituents and show that the surrogate preserves the $b/c/s/q$ discrimination of the full CLD reconstruction. The Parnassus CLD model achieves a generation cost of about 1.2 ms (40 ms) per event on a single GPU (CPU), over three (two) orders of magnitude faster than full simulation and reconstruction. Our model is publicly available for feasibility and design studies.

physics.ins-det↗

Towards Foundation Models on Hardware Accelerators for Particle Physics

Bandwidth constraints require many particle physics experiments to make real-time decisions on custom hardware or firmware running simplified algorithms, unlike offline analysis, where latency is usually not a limiting factor. For example, for particle jet tagging at colliders, state-of-the-art performance is achieved by foundation models with hundreds of millions of parameters pre-trained with billions of jets. We use knowledge distillation to transfer what such models have learned into efficient networks towards deployment in hardware accelerators. The teacher is the OmniLearned foundation model fine-tuned on top quark jet tagging; the student is an attention-free Deep Sets network. We demonstrate three ways the student's performance improves: adding a message-passing layer to the Deep Sets architecture, training on the teacher's soft labels rather than on ground-truth labels alone, and distilling from a pretrained teacher rather than from the same architecture trained from scratch. In each case the gain is largest in the background rejection at low signal efficiency, the regime that is most relevant for a trigger.

hep-ph↗

Cross-Detector Transfer Learning with Parnassus: From ALEPH to SLD

Parnassus is a fast detector-simulation and reconstruction framework that maps truth-level particles directly to reconstructed particles. In this work, we investigate cross-detector transfer learning by adapting a Parnassus model for the ALEPH detector to the SLD detector. ALEPH and SLD have similar detector responses, as they were both targeting hadronic $Z$-pole $e^+e^-$ events, while differing substantially in the underlying detector technology, reconstruction, and archived data representation. We initialize the SLD particle model with weights learned on ALEPH, fine-tune it on SLD, and compare it with the same architecture trained directly on SLD. The ALEPH-initialized model gives substantially improved particle- and jet-level agreement with the SLD reference, including a factor of 5.2 improvement in the charged-particle angular response and an improvement in the jet angular resolution from $1.73$ to $1.15$ times the SLD reference. The results show that detector-response information learned on ALEPH can be reused when modeling SLD and motivate reusable pretrained Parnassus models for legacy $e^+e^-$ detectors, which is especially critical for experiments without access to the original software pipeline. With this paper, we also release an AI-ready version of simulated SLD $e^+e^-$ events.

physics.ins-det↗

OmniCosmos: Transferring Particle Physics Knowledge Across the Cosmos

Foundation models build an effective representations of data that can be deployed on diverse downstream tasks. Previous research developed the OmniLearned foundation model for collider physics and showed that it could significantly advance discovery potential across collider experiments. In this paper we go beyond collider physics and show that Foundation Models trained on collider data can help improve the prediction of cosmological parameters and to predict halo and galaxy velocities in different datasets from CosmoBench. This is the first time a collider physics model is shown to generalize across scientific fields.

astro-ph.CO↗

Generation of Imaging Air Cherenkov Telescope images using Diffusion Models

Substantial amounts of air-shower simulations are needed to derive the instrument response for analyzing Imaging Air Cherenkov Telescope (IACT) data. This process is both computationally intensive and requires repetition under varying observation conditions, due to detector aging, changes in the atmosphere, or the instrument hardware. Generative models offer an efficient alternative, significantly accelerating simulations while compactly storing extensive simulation libraries, and providing a differentiable surrogate model of the instrument. However, their applicability has so far been limited in gamma-ray astronomy, particularly for modeling hadronic showers that dominate the background and exhibit significant intrinsic fluctuations that are challenging to model. In this study, we present the first application of score-based diffusion models to generate monoscopic $γ$-ray and proton shower images with nearly 2,000 pixels and benchmark the performance against Wasserstein GANs using H.E.S.S. simulations. We examine quality using both low-level parameters and well-established shower-shape observables, and take the first step towards analysis readiness by investigating $γ$-hadron separation. While GAN-based approaches can reproduce $γ$-ray showers with high fidelity, they fail to generate proton events of comparable quality, leading to a measurable degradation in analysis performance. In contrast, score-based diffusion modles achieve significantly superior quality for $γ$-ray and proton showers, accurately reproducing high-level correlations and generating events that are statistically indistinguishable from simulations at the analysis level. These results establish diffusion-based models as the first analysis-ready surrogate model of a single IACT, opening new prospects for fast instrument response generation, detector optimization, and connected downstream tasks.

astro-ph.IM↗

Cross-Domain Transfer with Particle Physics Foundation Models: From Jets to Neutrino Interactions

Future AI-based studies in particle physics will likely start from a foundation model to accelerate training and enhance sensitivity. As a step toward a general-purpose foundation model for particle physics, we investigate whether the OmniLearned and ParticleViT foundation models pretrained on diverse high-$Q^2$ simulated and real $pp$ and $ep$ collisions retain useful knowledge to a few-GeV fixed-target neutrino experiment. We process MINERvA neutrino--nucleus scattering events and evaluate pretrained models on two types of tasks: regression of available energy and binary classification of charged-current pion final states ($\mathrm{CC1π^{\pm}}$, $\mathrm{CCNπ^{\pm}}$, and $\mathrm{CC1π^{0}}$). Pretrained OmniLearned and ParticleViT models outperform similarly sized models trained from scratch at the same compute budget, with the largest gains for OmniLearned on regression and for ParticleViT on classification. When the same transformer architecture is instead initialized from unrelated text pretraining (BERT), this advantage appears only marginally for classification in terms of compute efficiency and not in any way for regression. These results suggest that particle-level foundation models acquire inductive biases that generalize across large differences in energy scale, detector technology, and underlying physics processes, pointing toward detector-agnostic inference in particle physics.

hep-ex↗

Predict before you train: Scaling Laws for particle physics foundation models

The largest machine learning models in particle physics are also the most expensive to train, yet the return on scaling a given architecture cannot be estimated before that compute is spent. Scaling laws have been fit for jets, but none has yet been shown to predict the performance of models it was not fit on. We show that, for a generic transformer pretrained on collider jets, it can be forecast. Fitting a joint model-and-data scaling law on small models alone, spanning three orders of magnitude of training compute, we predict the loss of models trained afterward with more than one hundred times more compute to within one percent. We then connect the forecast to downstream physics performance: across two standard tagging benchmarks, lower pretraining loss yields systematically lower fine-tuning loss and higher background rejection after fine-tuning. Within this model family and these tasks, a compute budget can therefore be translated into expected physics performance before any large model is trained. The final frontier model is consistent with the published numbers for current state-of-the-art physics-aware foundation models trained on the same corpus, on accuracy, AUC, and quark/gluon rejection, with a residual edge for the physics-aware model only in the high-purity tail of top tagging. We release five pretrained models spanning multiple sizes, together with the complete training recipe and code.

hep-ex↗

Differentiable Parametric Simulation and Reconstruction Models in Parnassus

Parnassus is a framework for fast detector simulation and reconstruction, directly mapping truth-level particles onto reconstructed objects. Such models can be built from deep generative networks trained on paired samples, which are fit automatically to a target detector, or from parametric prescriptions of the kind used by Delphes, which are constructed by hand. We remove this asymmetry by making the parametric models fully differentiable so that their parameters can be fit to a target sample by gradient descent. We demonstrate closure by fitting a parametric model to samples from a known configuration of itself, recovering the generating parameters and characterizing the degeneracies among them, and we present a first fit to CMS full simulation. The resulting models are interpretable, inexpensive, and run in the standard Parnassus pipeline which is fully Python based and GPU enabled.

hep-ex↗

An AI-based Detector Simulation and Reconstruction Model for the ALEPH Experiment at LEP

We present the application of Parnassus, a generative model for full detector simulation and reconstruction, to the ALEPH detector at the Large Electron-Positron Collider (LEP). Training on simulated $e^+e^-$ to Z to qqbar events processed through the ALEPH detector simulation and reconstruction, we demonstrate that Parnassus faithfully reproduces the detector response at the event, jet, and particle levels, with substantially better agreement than the Delphes fast simulation. The clean $e^+e^-$ environment, free of pileup and characterized by simple event topologies, provides a well-controlled benchmark for evaluating the generative model's fidelity. Our results demonstrate that modern neural-network-based generative simulation approaches, developed primarily for LHC experiments, generalize naturally to historical collider experiments with distinct detector geometries and physics environments. This work shows that Parnassus can be applied beyond the LHC context and serves as an important tool for legacy data analysis where archival software tools are challenging to resurrect.

physics.ins-det↗

Pre-Training for Simulation-Based Science: A Study on Jet Foundation Model Training Objectives

Foundation models (FMs) trained on large datasets and fine-tuned on downstream tasks have emerged as a powerful paradigm in AI for science. Industrial FMs are typically trained using self-supervision with masking due to the lack of labels. In many scientific domains, accurate simulations are plentiful and facilitate large, labeled datasets. This opens up new possibilities for pre-training. We present a systematic comparison of pre-training methods using the OmniLearned High Energy Physics FM framework. We test supervised classification, flow-matching generation, and self-supervised masked particle modeling. All models are pre-trained on the JetClass dataset and fine-tuned on two representative downstream tasks, top jet classification and JetNet conditional generation. Among other observations, for classification tasks, we find that pure classifier pre-training is optimal when downstream labels and model capacity are plentiful, but combining it with self-supervised masked particle modeling (MPM) is uniquely powerful in the low-finetuning label regime. Flow matching-based generative pre-training seems to provide little benefit for downstream classification, and interestingly, for downstream generation, we find that flow matching must be in the pre-training objective to see a significant finetuning advantage, hinting at the orthogonality of classification and generation tasks. That is, for a model to transfer to both generative and classification downstream tasks, it must be pre-trained on both. This study provides a template for controlled scaling analysis of pre-training objectives for foundation models in simulation-based sciences.

hep-ph↗

The Living Guide of Machine Learning for Particle Physics

We started the Living Review of Machine Learning for Particle Physics (HEP-ML Living Review) in 2020 as a community-maintained, near-comprehensive bibliography of machine learning in particle physics. The field was then growing faster than any single researcher could follow, finding the relevant papers was hard, and a structured, continuously updated reference paid off immediately. Since then the literature has grown by more than an order of magnitude, the methods reach far beyond the classification and generation tasks of the early years, and the community has built its own ecosystem of topic-specific reviews, benchmark papers, and software frameworks. The original model no longer serves this field well, and we can no longer sustain it. We therefore change direction. We freeze the Living Review as an archival reference covering the literature up to 1 June 2026, where it remains a stable record of the first phase of HEP-ML. A new resource, the HEP-ML Living Guide, replaces it. It does not list everything. It curates, it annotates, and it points readers to foundational and representative work, so that researchers can find their way into a mature and rapidly diversifying field. In this article we explain why we make this change and how the new resource works.

hep-ph↗

Explicit or Implicit? Encoding Physics at the Precision Frontier

High-performance machine learning tools in particle physics rest on two complementary directions: encoding symmetries explicitly in the architecture, and implicitly learning the structure of the data through large-scale (pre-) training. We compare the performance of the representative L-GATr and OmniLearn models on three especially challenging tasks: reweighting-based unfolding, likelihood-ratio estimation, and weakly supervised anomaly detection. Across all benchmarks, both methods achieve comparable performance given the statistical precision of the finetuning datasets, suggesting that the significant efficiency gains from encoding known particle physics structures are largely method-independent.

hep-ph↗

The Well-Tempered Likelihood: Honest Confidence Intervals for Misspecified Models

Likelihood-based inference in particle physics, and in the physical sciences more broadly, relies on the assumption that the model accurately describes the data. When the model is misspecified, though, standard confidence intervals shrink to zero width with increasing data, producing overconfident and potentially misleading constraints. We propose the well-tempered likelihood, which divides the likelihood-ratio test statistic by a goodness-of-fit (GOF) statistic evaluated at the best-fit point. Under correct specification, the GOF is $\mathcal{O}(1)$ and standard inference is recovered. Under misspecification, both the likelihood and the GOF scale as $\mathcal{O}(N)$ for $N$ data points, so their ratio remains $\mathcal{O}(1)$ and the resulting well-tempered confidence interval self-limits at a floor determined by the model's inadequacy, essentially reducing the effective sample size. In other words, \textit{all models are correct, as long as your dataset is small enough}. We present binned and unbinned formulations of the well-tempered likelihood---the latter based on a classifier two-sample test---and demonstrate our method on a Gaussian example and on a measurement of the strong coupling constant using synthetic electron-positron collisions.

stat.ME↗

A Scientific Human-Agent Reproduction Pipeline

Reproducing scientific analyses is essential for preserving knowledge, building extensible codebases, and deepening researcher understanding - yet the effort often outweighs its academic recognition. We argue that the reproduction of scientific data analyses is fundamentally a translation task: converting human-readable knowledge (papers, documentation) into machine-readable analysis code. This makes it uniquely well-suited for AI agents. We present SHARP (Scientific Human-Agent Reproduction Pipeline), a structured framework for reproducing scientific analyses through human-agent collaboration. SHARP decomposes a reproduction task into discrete steps, which an AI agent executes autonomously using specialized subagents for code generation, testing, and quality assurance. At defined checkpoints, the researcher reviews progress, provides feedback, and steers the analysis - keeping the human firmly in control of scientific judgment while the agent handles implementation. We demonstrate SHARP by reproducing a jet classification task in particle physics from a published paper. We evaluate the reproduction along three axes: analysis performance against the original results, code quality and faithfulness, and the nature of the human-agent conversation. The latter is evaluated with a novel framework for characterizing human-agent interactions. Our work highlights a practical model for AI-assisted scientific reproduction where the researcher's role shifts from writing code to understanding, evaluating, and directing - elevating human understanding rather than replacing it.

hep-ph↗