Search arXiv⌕ Search

arXiv · 2204.05095

Physics is the New Data

Abstract

The rapid development of machine learning (ML) methods has fundamentally affected numerous applications ranging from computer vision, biology, and medicine to accounting and text analytics. Until now, it was the availability of large and often labeled data sets that enabled significant breakthroughs. However, the adoption of these methods in classical physical disciplines has been relatively slow, a tendency that can be traced to the intrinsic differences between correlative approaches of purely data-based ML and the causal hypothesis-driven nature of physical sciences. Furthermore, anomalous behaviors of classical ML necessitate addressing issues such as explainability and fairness of ML. We also note the sequence in which deep learning became mainstream in different scientific disciplines - starting from medicine and biology and then towards theoretical chemistry, and only after that, physics - is rooted in the progressively more complex level of descriptors, constraints, and causal structures available for incorporation in ML architectures. Here we put forth that over the next decade, physics will become a new data, and this will continue the transition from dot-coms and scientific computing concepts of the 90ies to big data of 2000-2010 to deep learning of 2010-2020 to physics-enabled scientific ML.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Sergei V. Kalinin, Maxim Ziatdinov, Bobby G. Sumpter, Andrew D. White. 2022-04-11. Physics is the New Data. https://arxiv.org/abs/2204.05095

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Track finding and particle identification performance with particle physics foundation models

Modern high energy nuclear and particle physics experiments produce large amounts of sparse data that must be reduced significantly in size before performing physics analysis. Recently, there has been an effort to evaluate Foundation Models as a potential tool for performing data analysis. These models have been shown to learn features in high dimensional datasets based on the multi-modal data they are trained on. To show their effectiveness at performing complex pattern recognition tasks, such as reconstructing charged particles in a magnetic field, we evaluated the performance of a Foundation Model based reconstruction on several downstream tasks with a dataset composed of spacepoints in a Time Projection Chamber. We show that the performance of the Foundation Model based data analysis significantly improves upon that of traditional methods, and furthermore can be adapted to learn additional tasks that are not necessarily related to the initial training objective.

physics.data-an↗

An Algebra Bundle for Non-Composable Coincidence Probabilities in Gamma-ray Spectroscopy

Understanding nuclear level schemes from the detection of emitted gamma-rays is, at its core, a combinatorial problem. The transition matrix formalism that treats nuclear decay as a Markov process is a well established treatment for the prediction of emitted and detected gamma-rays. However, with the path algebra being the underlying algebra of such matrix methods, the formalism is restricted to calculating probabilities only for composable paths through the decay. This paper presents a new algebra that allows for the calculations of non-composable coincidence probabilities offering a more complete formalism for the prediction of gamma-ray spectra. The aim of this \textit{coincidence algebra} is to provide a general treatment for predicting all full energy summing peaks for composable and non-composable transitions. Non-composable summing peaks often corrupt peaks of interest by creating doublets in the energy spectra. The coincidence algebra serves as a tool for investigating any possible doublets produced from full energy coincidence summing. This formalism is tested for the prediction of gamma-ray peaks in the electron capture of $^{133}$Ba and compared to the results a Geant4 simulation of the decay within the GRIFFIN spectrometer. It is also shown how the path algebra formalism may be useful for understanding uncertainty propagation in nuclear level schemes.

physics.data-an↗

When Should Team KPIs Be Absolute or Relative for Match-Outcome Prediction?

In rugby union and association football, team key performance indicators (KPIs) can be represented in absolute terms or relative to the opponent. Relativisation sometimes improves match-outcome prediction and sometimes harms it. There has been no general account of when each occurs. The answer depends on how much the two teams differ in variability and how strongly their KPI values rise and fall together. We combine these properties into the Paired Efficiency Factor (PEF), which generalises Fisher's paired-efficiency result to the unequal-variance conditions typical of competitive sport. The PEF also connects a KPI's statistical efficiency to how much information its relative form carries about the outcome. Combined KPIs can interact in complex ways, so we analyse each indicator on its own. Across 86 team KPIs from professional rugby union and association football, the PEF places every metric in one of four regimes. Anti-correlation is common among these KPIs, especially for high-volume competitive counts, and absolute measures are then usually preferable. Relativisation can still improve prediction when a noisier difference carries more outcome information. An idealised simulation and one representative KPI from each regime confirm both signs under team-blocked cross-validation. The same pairing geometry appears in healthcare, genomics, finance, and manufacturing. The PEF is a diagnostic for when to relativise a performance metric and when not to.

physics.data-an↗