arXiv subjects

Christopher Bennett

Publications and source records attributed to Christopher Bennett.

10 recordsLinked to original sources

arXiv2026

Incorruptible Neural Networks: Training Models that can Generalize to Large Internal Perturbations

Flat regions of the neural network loss landscape have long been hypothesized to correlate with better generalization properties. A closely related but distinct problem is training models that are robust to internal perturbations to their weights, which may be an important need for future low-power hardware platforms. In this paper, we explore the usage of two methods, sharpness-aware minimization (SAM) and random-weight perturbation (RWP), to find minima robust to a variety of random corruptions to weights. We consider the problem from two angles: generalization (how do we reduce the noise-robust generalization gap) and optimization (how do we maximize performance from optimizers when subject to strong perturbations). First, we establish, both theoretically and empirically, that an over-regularized RWP training objective is optimal for noise-robust generalization. For small-magnitude noise, we find that SAM's adversarial objective further improves performance over any RWP configuration, but performs poorly for large-magnitude noise. We link the cause of this to a vanishing-gradient effect, caused by unevenness in the loss landscape, affecting both SAM and RWP. Lastly, we demonstrate that dynamically adjusting the perturbation strength to match the evolution of the loss landscape improves optimizing for these perturbed objectives.

cs.LG↗

arXiv2026

Strong radial electric field scaling near nanoscale conductive filaments and the ReRAM resistive switching mechanism

The physics underlying reset in bipolar resistive memory has been the subject of decades of controversy and has been identified as the primary barrier to resistive memory technology development. This manuscript introduces a nanoscale effect in current carrying conductors, whereby surface charge induced radial electric fields are found to be inversely proportional to the radius of the conductive path. This nanoscale effect is then applied to explain the negative resistance switching (reset) mechanism in filamentary metal oxide resistive switching memory devices (memristors). Previous explanations for the negative resistive switching mechanism state that diffusion constitutes the radial driving mechanism for oxygen ions, and drift under electric fields is restricted to the direction parallel to current flow. This explanation conflicts with retention and microscopy data collected in a subset of devices presented in literature. We demonstrate that the electric field's dependency on the on the radius of a nanoscale conductive path can result in radial fields on the order of 10^5 to 10^6 V/cm at only -1 V bias, sufficient to govern the negative resistance switching mechanism in filamentary metal oxides. By accounting for this nanoscale size effect, long standing anomalous experimental data about the negative (reset) resistance switching mechanism in bipolar filamentary resistive memory devices is finally reconciled. Wide understanding of surface charges and associated electric fields in nanoscale conductive paths could prove important for further scaling of integrated circuits and aid in elucidating many nanoscale phenomena.

cond-mat.mes-hall↗

arXiv2025

Review of Machine Learning for Micro-Electronic Design Verification

Microelectronic design verification remains a critical bottleneck in device development, traditionally mitigated by expanding verification teams and computational resources. Since the late 1990s, machine learning (ML) has been proposed to enhance verification efficiency, yet many techniques have not achieved mainstream adoption. This review, from the perspective of verification and ML practitioners, examines the application of ML in dynamic-based techniques for functional verification of microelectronic designs, and provides a starting point for those new to this interdisciplinary field. Historical trends, techniques, ML types, and evaluation baselines are analysed to understand why previous research has not been widely adopted in industry. The review highlights the application of ML, the techniques used and critically discusses their limitations and successes. Although there is a wealth of promising research, real-world adoption is hindered by challenges in comparing techniques, identifying suitable applications, and the expertise required for implementation. This review proposes that the field can progress through the creation and use of open datasets, common benchmarks, and verification targets. By establishing open evaluation criteria, industry can guide future research. Parallels with ML in software verification suggest potential for collaboration. Additionally, greater use of open-source designs and verification environments can allow more researchers from outside the hardware verification discipline to contribute to the challenge of verifying microelectronic designs.

cs.AR↗

arXiv2025

Analog Bayesian neural networks are insensitive to the shape of the weight distribution

Recent work has demonstrated that Bayesian neural networks (BNN's) trained with mean field variational inference (MFVI) can be implemented in analog hardware, promising orders of magnitude energy savings compared to the standard digital implementations. However, while Gaussians are typically used as the variational distribution in MFVI, it is difficult to precisely control the shape of the noise distributions produced by sampling analog devices. This paper introduces a method for MFVI training using real device noise as the variational distribution. Furthermore, we demonstrate empirically that the predictive distributions from BNN's with the same weight means and variances converge to the same distribution, regardless of the shape of the variational distribution. This result suggests that analog device designers do not need to consider the shape of the device noise distribution when hardware-implementing BNNs performing MFVI.

cs.LG↗

arXiv2024

Photothermal Spectroscopy for Planetary Sciences: A Characterization of Planetary Materials in the Mid-IR

Understanding of the formation and evolution of the Solar System requires understanding key and common materials found on and in planetary bodies. Mineral mixing and its implications on planetary body formation is a topic of high interest to the planetary science community. Previous work establishes a case for the use of Optical PhotoThermal InfraRed (O-PTIR) in planetary science and introduces and demonstrates the technique's capability to study planetary materials. In this paper, we performed a measurement campaign on granular materials relevant to planetary science, such as minerals found in lunar and martian soils. These laboratory measurements serve to start a database of O-PTIR measurements. We also present FTIR absorption measurements of the materials we observed in O-PTIR for comparison purposes. We find that the O-PTIR technique suffers from granular orientation effects similar to other IR techniques, but in most cases, is is directly comparable to commonly used absorption spectroscopy techniques. We conclude that O-PTIR would be an excellent tool for the purpose of planetary material identification during in-situ investigations on regolith and bedrock surfaces.

astro-ph.EP↗

arXiv2024

Photothermal Spectroscopy for Planetary Sciences: Mid-IR Absorption Made Easy

The understanding of the formation and evolution of the solar system still has many unanswered questions. Formation of solids in the solar system, mineral and organic mixing, and planetary body creation are all topics of interest to the community. Studying these phenomena is often performed through observations, remote sensing, and in-situ analysis, but there are limitations to the methods. Limitations such as IR diffraction limits, spatial resolution issues, and spectral resolution issues can prevent detection of organics, detection and identification of cellular structures, and the disentangling of granular mixtures. Optical-PhotoThermal InfraRed (O-PTIR) spectroscopy is a relatively new method of spectroscopy currently used in fields other than planetary sciences. O-PTIR is a non-destructive, highly repeatable, and fast form of measurement capable of reducing these limitations. Using a dual laser system with an IR source tuned to the mid-IR wavelength we performed laboratory O-PTIR measurements to compare O-PTIR data to existing IR absorption data and laboratory FTIR measurements for planetary materials. We do this for the purpose of introducing O-PTIR to the planetary science community. The technique featured here would serve to better measurements of planetary bodies during in-situ analysis. We find that, unlike other fields where O-PTIR produces almost one-to-one measurements with IR absorption measurements of the same material, granular materials relevant to planetary science do not. However, we do find that the materials compared were significantly close and O-PTIR was still capable of identifying materials relevant to planetary science.

astro-ph.EP↗

arXiv2022

An out-of-distribution discriminator based on Bayesian neural network epistemic uncertainty

Neural networks have revolutionized the field of machine learning with increased predictive capability. In addition to improving the predictions of neural networks, there is a simultaneous demand for reliable uncertainty quantification on estimates made by machine learning methods such as neural networks. Bayesian neural networks (BNNs) are an important type of neural network with built-in capability for quantifying uncertainty. This paper discusses aleatoric and epistemic uncertainty in BNNs and how they can be calculated. With an example dataset of images where the goal is to identify the amplitude of an event in the image, it is shown that epistemic uncertainty tends to be lower in images which are well-represented in the training dataset and tends to be high in images which are not well-represented. An algorithm for out-of-distribution (OoD) detection with BNN epistemic uncertainty is introduced along with various experiments demonstrating factors influencing the OoD detection capability in a BNN. The OoD detection capability with epistemic uncertainty is shown to be comparable to the OoD detection in the discriminator network of a generative adversarial network (GAN) with comparable network architecture.

cs.LG↗

arXiv2021

Quantum yield and charge diffusion in the Nancy Grace Roman Space Telescope infrared detectors

The shear signal required for weak lensing analyses is small, so any detector-level effects which distort astronomical images can contaminate the inferred shear. The Nancy Grace Roman Space Telescope (Roman) will fly a focal plane with 18 Teledyne H4RG-10 near infrared (IR) detector arrays; these have never been used for weak lensing and they present unique instrument calibration challenges. A pair of previous investigations (Hirata & Choi 2020; Choi & Hirata 2020) demonstrated that spatiotemporal correlations of flat fields can effectively separate the brighter-fatter effect (BFE) and interpixel capacitance (IPC). Later work (Freudenburg et al. 2020) introduced a Fourier-space treatment of these correlations which allowed the authors to expand to higher orders in BFE, IPC, and classical nonlinearity (CNL). This work expands the previous formalism to include quantum yield and charge diffusion. We test the updated formalism on simulations and show that we can recover input characterization values. We then apply the formalism to visible and IR flat field data from three Roman flight candidate detectors. We fit a 2D Gaussian model to the charge diffusion at 0.5 $\mu$m wavelength, and find variances of $C_{11} = 0.1066\pm 0.0011$ pix$^2$ in the horizontal direction, $C_{22} = 0.1136\pm 0.0012$ pix$^2$ in the vertical direction, and a covariance of $C_{12} = 0.0001\pm 0.0007$ pix$^2$ (stat) for SCA 20829. Last, we convert the asymmetry of the charge diffusion into an equivalent shear signal, and find a contamination of the shear correlation function to be $\xi_+ \sim 10^{-6}$ for each detector. This exceeds Roman's allotted error budget for the measurement by a factor of $\mathcal{O}(10)$ in power (amplitude squared) but can likely be mitigated through standard methods for fitting the point spread function (PSF) since charge diffusion can be treated as a contribution to the PSF.

astro-ph.IM↗

arXiv2020

Critical Laboratory Studies to Advance Planetary Science and Support Missions

Laboratory studies for planetary science and astrobiology aimat advancing our understanding of the Solar System through the promotion of theoretical and experimental research into the underlying processes that shape it. Laboratory studies (experimental and theoretical) are crucial to interpret observations and mission data, and are key incubators for new mission concepts as well as instrument development and calibration. They also play a vital role in determining habitability of Solar System bodies, enhancing our understanding of the origin of life, and in the search for signs of life beyond Earth, all critical elements of astrobiology. Here we present an overview of the planetary science areas where laboratory studies are critically needed, in particular in the next decade. These areas include planetary & satellites atmospheres, surfaces, and interiors, primitive bodies such as asteroids, meteorites, comets, and trans-Neptunian objects, and signs of life. Generating targeted experimental and theoretical laboratory data that are relevant for a better understanding of the physical, chemical, and biological processes occurring in these environments is crucial. For each area we present i) a brief overview of the state-of-the-art laboratory work, ii) the challenges to analyze and interpret data sets from missions and ground-based observations and to support mission and concept development, and iii) recommendations for high priority laboratory studies.

astro-ph.IM↗

arXiv2020

Combining multi-site Magnetic Resonance Imaging with machine learning predicts survival in paediatric brain tumours

Background Brain tumours represent the highest cause of mortality in the paediatric oncological population. Diagnosis is commonly performed with magnetic resonance imaging and spectroscopy. Survival biomarkers are challenging to identify due to the relatively low numbers of individual tumour types, especially for rare tumour types such as atypical rhabdoid tumours. Methods 69 children with biopsy-confirmed brain tumours were recruited into this study. All participants had both perfusion and diffusion weighted imaging performed at diagnosis. Data were processed using conventional methods, and a Bayesian survival analysis performed. Unsupervised and supervised machine learning were performed with the survival features, to determine novel sub-groups related to survival. Sub-group analysis was undertaken to understand differences in imaging features, which pertain to survival. Findings Survival analysis showed that a combination of diffusion and perfusion imaging were able to determine two novel sub-groups of brain tumours with different survival characteristics (p <0.01), which were subsequently classified with high accuracy (98%) by a neural network. Further analysis of high-grade tumours showed a marked difference in survival (p=0.029) between the two clusters with high risk and low risk imaging features. Interpretation This study has developed a novel model of survival for paediatric brain tumours, with an implementation ready for integration into clinical practice. Results show that tumour perfusion plays a key role in determining survival in brain tumours and should be considered as a high priority for future imaging protocols.

q-bio.QM↗