Search arXiv⌕ Search

arXiv subjects

Jeffrey Humpherys

Publications and source records attributed to Jeffrey Humpherys.

At least 19 recordsLinked to original sources

Accuracy Is Not Risk: Why Medical AI Should Not Report Only Its Most Likely Label

Background. Many medical AI models are trained to reproduce a single reference label and hand the most likely label to the next step in a clinical workflow. A classifier can select that label correctly while providing an inadequate summary for estimating downstream risk. Methods. We use Jeffrey's rule of conditioning to specify when probabilities over intermediate states, such as diagnoses or imaging categories, can be carried forward to an outcome risk. We separate two errors of reporting only the most likely label, discarding the probability of the other states and applying the risk of patients who have the leading diagnosis to a patient who only probably has it. We also give conditions under which the label and the full distribution lead to the same decision, and we propose guardrails for device developers, regulatory reviewers, and health insurers. Results. In a hypothetical chest-pain differential, reporting only the benign leading diagnosis greatly understates the patient's risk of death or cardiac arrest, so a patient who warrants evaluation could be discharged or denied imaging. In a hypothetical BI-RADS example, the most likely category is "probably benign," yet the propagated malignancy risk exceeds the ceiling that defines that category. Conclusions. A predicted label is not an observed state, and a calibrated classifier is not automatically a valid outcome model. Clinical and insurance coverage decisions should rest on the patient's outcome risk, judged against a threshold justified by the consequences of acting and not acting. Developers should state what each model output means and check that every step between the model and the decision preserves the patient's risk.

stat.ME↗

Spectral stability for strong ideal-gas shock layers

We give a purely analytical proof of one-dimensional spectral stability of sufficiently strong shock layers for the full ideal-gas Navier--Stokes equations with constant viscosity and heat conduction. Earlier work reduced this question to a limiting problem and gave numerical evidence of stability, but no proof. We prove stability on an explicit region of gas constants and transport ratios that includes air and monatomic gases. No step of the argument relies on numerical computation, and the arguments, taking the cited results of Humpherys, Lyng, and Zumbrun as hypotheses, have also been verified in the Lean proof assistant.

math.AP↗

The De Cock--De Moor Conjecture: Proof, Normal Form, and Indefinite Angles

De Cock and De Moor conjectured that two matrices built from the solutions of three coupled Lyapunov equations always share their eigenvalues, an identity linking principal angles between model subspaces with the canonical correlations between the past and future of a stochastic process. The conjecture was recorded as Problem 9.1 of \emph{Unsolved Problems in Mathematical Systems and Control Theory}. We prove it under the natural nonresonance condition, without stability or diagonalizability, and show that the two matrices are similar. The proof exposes a Cauchy-matrix structure created by the rank-one perturbation and reduces the problem to rational interpolation, and the main theorem has also been verified in the Lean~4 proof assistant. The same structure gives a normal form that depends only on the poles and zeros of the model. Off the stable set the eigenvalues become squared cosines of angles in an indefinite metric. We prove an inertia theorem for them and show that reflecting a pole or a zero across the unit circle acts on the angles by a principal pivot transform. For several inputs and outputs, where the conjecture fails, we identify the subspaces whose angles do give the canonical correlations. We also relate our approach to the independent proof of Gillberg and Löfberg.

math.OC↗

Riccati Stability Without Auxiliary Matrices

In the 2004 collection \emph{Unsolved Problems in Mathematical Systems and Control Theory}, Erik Verriest posed the problem of characterizing Riccati stability ``without invoking additional matrices.'' We give such a characterization through a scalar invariant of the resolvent family. The invariant is defined by covariance balances using at most $n^2+1$ frequency--direction pairs. A finite-dimensional separation argument shows that this covariance radius equals the optimal common ellipsoidal norm of the resolvent family. Combined with the strict bounded real lemma, this yields a necessary and sufficient condition for Riccati stability involving only the Hurwitz property of the first matrix and a single scalar inequality. The invariant reduces to the ordinary spectral radius for one matrix, lies between the pointwise spectral-radius and unscaled small-gain levels of the resolvent family, and coincides with the operator-space spectral radius of Shalit and Shamovich for the natural resolvent function space. The main results have been formally verified in the Lean proof assistant.

math.OC↗

Tandem Blocks in Deep Convolutional Neural Networks

Due to the success of residual networks (resnets) and related architectures, shortcut connections have quickly become standard tools for building convolutional neural networks. The explanations in the literature for the apparent effectiveness of shortcuts are varied and often contradictory. We hypothesize that shortcuts work primarily because they act as linear counterparts to nonlinear layers. We test this hypothesis by using several variations on the standard residual block, with different types of linear connections, to build small image classification networks. Our experiments show that other kinds of linear connections can be even more effective than the identity shortcuts. Our results also suggest that the best type of linear connection for a given application may depend on both network width and depth.

stat.ML↗

Euler vs. Lagrange: The role of coordinates in practical Evans-function computations

The Evans function has become a standard tool in the mathematical study of nonlinear wave stability. In particular, computation of its zero set gives a convenient numerical method for determining the point spectrum of the associated linear operator (and thus the spectral stability of the wave in question). We report on an unexpected complication that frustrates this computation for viscous shock profiles in gas dynamics. Although this phenomenon---related to the choice of Eulerian or Lagrangian coordinate system used to describe the gas---is present already in the one-dimensional setting, its implications are especially important in the multidimensional case where no computationally viable Lagrangian description of the gas is readily available. We introduce new "pseudo-Lagrangian" coordinates that allow us to overcome this difficulty, and we illustrate the utility of these coordinates in the setting of isentropic gas dynamics in two space dimensions.

math.AP↗

Forward Thinking: Building and Training Neural Networks One Layer at a Time

We present a general framework for training deep neural networks without backpropagation. This substantially decreases training time and also allows for construction of deep networks with many sorts of learners, including networks whose layers are defined by functions that are not easily differentiated, like decision trees. The main idea is that layers can be trained one at a time, and once they are trained, the input data are mapped forward through the layer to create a new learning problem. The process is repeated, transforming the data through multiple layers, one at a time, rendering a new data set, which is expected to be better behaved, and on which a final output layer can achieve good performance. We call this forward thinking and demonstrate a proof of concept by achieving state-of-the-art accuracy on the MNIST dataset for convolutional neural networks. We also provide a general mathematical formulation of forward thinking that allows for other types of deep learning problems to be considered.

stat.ML↗

Forward Thinking: Building Deep Random Forests

The success of deep neural networks has inspired many to wonder whether other learners could benefit from deep, layered architectures. We present a general framework called forward thinking for deep learning that generalizes the architectural flexibility and sophistication of deep neural networks while also allowing for (i) different types of learning functions in the network, other than neurons, and (ii) the ability to adaptively deepen the network as needed to improve results. This is done by training one layer at a time, and once a layer is trained, the input data are mapped forward through the layer to create a new learning problem. The process is then repeated, transforming the data through multiple layers, one at a time, rendering a new dataset, which is expected to be better behaved, and on which a final output layer can achieve good performance. In the case where the neurons of deep neural nets are replaced with decision trees, we call the result a Forward Thinking Deep Random Forest (FTDRF). We demonstrate a proof of concept by applying FTDRF on the MNIST dataset. We also provide a general mathematical formulation that allows for other types of deep learning problems to be considered.

stat.ML↗

Balanced flux formulations for multidimensional Evans function computations for viscous shocks

The Evans function is a powerful tool for the stability analysis of viscous shock profiles; zeros of this function carry stability information. In the one-dimensional case, it is typical to compute the Evans function using Goodman's integrated coordinates [G1]; this device facilitates the search for zeros of the Evans function by winding number arguments. Although integrated coordinates are not available in the multidimensional case, we show here that there is a choice of coordinates which gives similar advantages.

math.AP↗

Multidimensional stability of large-amplitude Navier-Stokes shocks

Extending results of Humpherys-Lyng-Zumbrun in the one-dimensional case, we use a combination of asymptotic ODE estimates and numerical Evans-function computations to examine the multidimensional stability of planar Navier--Stokes shocks across the full range of shock amplitudes, including the infinite-amplitude limit, for monatomic or diatomic ideal gas equations of state and viscosity and heat conduction coefficients $μ$, $μ+η$, and $ν=κ/c_v$ in the physical ratios predicted by statistical mechanics, with Mach number $M>1.035$. Our results indicate unconditional stability within the parameter range considered; this agrees with the results of Erpenbeck and Majda for the corresponding inviscid case of Euler shocks. Notably, this study includes the first successful numerical computation of an Evans function associated with the multidimensional stability of a viscous shock wave. The methods introduced may be used in principle to decide stability for any $γ$-law gas, $γ>1$, and arbitrary $μ>|η|\ge 0$, $ν>0$ or, indeed, for shocks of much more general models and equations, including in particular viscoelasticity, combustion, and magnetohydrodynamics (MHD).

math.AP↗

Viscous hyperstabilization of detonation waves in one space dimension

It has long been a standard practice to neglect diffusive effects in stability analyses of detonation waves. Here, with the principal aim of quantifying the impact of these oft-neglected effects on the stability characteristics of such waves, we use numerical Evans-function techniques to study the (spectral) stability of viscous strong detonation waves---particular traveling-wave solutions of the Navier-Stokes equations modeling a mixture of reacting gases. Remarkably, our results show a surprising synergy between the high-activation-energy limit typically studied in stability analyses of detonation waves and the presence of small but nonzero diffusive effects. While our calculations do show a modest delay in the onset of instability in agreement with recently reported calculations by direct numerical simulation of the physical equations, our approach, based on the Evans function, also provides additional spectral information. In particular, for each of the families of detonation waves in our computational domain, we find a completely unexpected kind of hysteresis in the limit of increasing activation energy; that is, our calculations suggest that, whenever diffusive effects are present, there is a return to stability as unstable eigenvalues return to the stable complex half plane.

math.AP↗

Stability of viscous weak detonation waves for Majda's model

Continuing the program initiated by Humpherys, Lyng, & Zumbrun [17] for strong detonation waves, we use a combination of analytical and numerical Evans-function techniques to analyze the spectral stability of weak detonation waves in a simplified model for gas-dynamical combustion. Combining these new spectral stability results with the pointwise Green function analysis of Lyng, Raoofi, Texier, & Zumbrun [22], we conclude that these waves are nonlinearly stable. The principal novelty of this analysis is the treatment of weak detonation waves. In contrast to the case of strong detonation waves, weak detonation waves are undercompressive and the stability of these waves is delicate and has not been treated by standard weighted-norm techniques. The present analysis thus provides a case study illustrating the flexibility and power of the Evans-function- based approach to stability. As in the case of strong detonations, we find that all tested waves are spectrally stable, hence nonlinearly stable.

math.AP↗

Stability of viscous detonations for Majda's model

Using analytical and numerical Evans-function techniques, we examine the spectral stability of strong-detonation-wave solutions of Majda's scalar model for a reacting gas mixture with an Arrhenius-type ignition function. We introduce an efficient energy estimate to limit possible unstable eigenvalues to a compact region in the unstable complex half plane, and we use a numerical approximation of the Evans function to search for possible unstable eigenvalues in this region. Our results show, for the parameter values tested, that these waves are spectrally stable. Combining these numerical results with the pointwise Green function analysis of Lyng, Raoofi, Texier, & Zumbrun [J. Differential Equations 233 (2007), no. 2, 654-698.], we conclude that these waves are nonlinearly stable. This represents the first demonstration of nonlinear stability for detonation-wave solutions of the Majda model without a smallness assumption. Notably, our results indicate that, for the simplified Majda model, there does not occur, either in a normal parameter range or in the limit of high activation energy, Hopf bifurcation to "galloping" or "pulsating" solutions as is observed in the full reactive Navier-Stokes equations. This answers in the negative a question posed by Majda as to whether the scalar detonation model captures this aspect of detonation behavior.

math.AP↗

Efficient numerical stability analysis of detonation waves in ZND

As described in the classic works of Lee--Stewart and Short--Stewart, the numerical evaluation of linear stability of planar detonation waves is a computationally intensive problem of considerable interest in applications. Reexamining this problem from a modern numerical Evans function point of view, we derive a new algorithm for their stability analysis, related to a much older method of Erpenbeck, that, while equally simple and easy to implement as the standard method introduced by Lee--Stewart, appears to be potentially faster and more stable.

math.NA↗

Computing expected transition events in reducible Markov chains

We present a closed-form, computable expression for the expected number of times any transition event occurs during the transient phase of a reducible Markov chain. Examples of events include time to absorption, number of visits to a state, traversals of a particular transition, loops from a state to itself, and arrivals to a state from a particular subset of states. We give an analogous expression for time-average events, which describe the steady-state behavior of reducible chains as well as the long-term behavior of irreducible chains.

math.PR↗

One-dimensional stability of parallel shock layers in isentropic magnetohydrodynamic

Extending investigations of Barker, Humpherys, Lafitte, Rudd, and Zumbrun for compressible gas dynamics and Freistühler and Trakhinin for compressible magnetohydrodynamics, we study by a combination of asymptotic ODE estimates and numerical Evans function computations the one-dimensional stability of parallel isentropic magnetohydrodynamic shock layers over the full range of physical parameters (shock amplitude, strength of imposed magnetic field, viscosity, magnetic permeability, and electrical resistivity) for a $γ$-law gas with $γ\in [1,3]$. Other $γ$-values may be treated similarly, but were not checked numerically. Depending on magnetic field strength, these shocks may be of fast Lax, intermediate (overcompressive), or slow Lax type; however, the shock layer is independent of magnetic field, consisting of a purely gas-dynamical profile. In each case, our results indicate stability. Interesting features of the analysis are the need to renormalize the Evans function in order to pass continuously across parameter values where the shock changes type or toward the large-amplitude limit at frequency $λ=0$ and the systematic use of winding number computations on Riemann surfaces.

math.AP↗

On the shock wave spectrum for isentropic gas dynamics with capillarity

We consider the stability problem for shock layers in Slemrod's model of an isentropic gas with capillarity. We show that these traveling waves are monotone in the weak capillarity case, and become highly oscillatory as the capillarity strength increases. Using a spectral energy estimate we prove that small-amplitude monotone shocks are spectrally stable. We also show, through the use of a novel spectral energy estimate, that monotone shocks have no unstable real spectrum regardless of amplitude; this implies that any instabilities of these monotone traveling waves, if they exist, must occur through a Hopf-like bifurcation, where one or more conjugate pairs of eigenvalues cross the imaginary axis. We then conduct a systematic numerical Evans function study, which shows that monotone and mildly oscillatory profiles in an adiabatic gas are spectrally stable for moderate values of shock and capillarity strengths. In particular, we show that the transition from monotone to non-monotone profiles does not appear to trigger any instabilities.

math.AP↗

Stability of strong ideal-gas shock layers

Extending recent results in the isentropic case, we use a combination of asymptotic ODE estimates and numerical Evans-function computations to examine the spectral stability of shock-wave solutions of the compressible Navier--Stokes equations with ideal gas equation of state. Our main results are that, in appropriately rescaled coordinates, the Evans function associated with the linearized operator about the wave (i) converges in the large-amplitude limit to the Evans function for a limiting shock profile of the same equations, for which internal energy vanishes at one endstate; and (ii) has no unstable (positive real part) zeros outside a uniform ball $|λ|\le Λ$. Thus, the rescaled eigenvalue ODE for the set of all shock waves, augmented with the (nonphysical) limiting case, form a compact family of boundary-value problems that can be conveniently investigated numerically. An extensive numerical Evans-function study yields one-dimensional spectral stability, independent of amplitude, for gas constant $γ$ in $[1.2, 3]$ and ratio $ν/μ$ of heat conduction to viscosity coefficient within $[0.2,5]$ ($γ\approx 1.4$, $ν/μ\approx 1.47$ for air). Other values may be treated similarly but were not considered. The method of analysis extends also to the multi-dimensional case, a direction that we shall pursue in a future work.

math-ph↗