arXiv subjects

David Foster

Publications and source records attributed to David Foster.

17 recordsLinked to original sources

arXiv2025

Guidelines for Applying RL and MARL in Cybersecurity Applications

Reinforcement Learning (RL) and Multi-Agent Reinforcement Learning (MARL) have emerged as promising methodologies for addressing challenges in automated cyber defence (ACD). These techniques offer adaptive decision-making capabilities in high-dimensional, adversarial environments. This report provides a structured set of guidelines for cybersecurity professionals and researchers to assess the suitability of RL and MARL for specific use cases, considering factors such as explainability, exploration needs, and the complexity of multi-agent coordination. It also discusses key algorithmic approaches, implementation challenges, and real-world constraints, such as data scarcity and adversarial interference. The report further outlines open research questions, including policy optimality, agent cooperation levels, and the integration of MARL systems into operational cybersecurity frameworks. By bridging theoretical advancements and practical deployment, these guidelines aim to enhance the effectiveness of AI-driven cyber defence strategies.

cs.AI↗

arXiv2024

Multi-Agent Reinforcement Learning for Maritime Operational Technology Cyber Security

This paper demonstrates the potential for autonomous cyber defence to be applied on industrial control systems and provides a baseline environment to further explore Multi-Agent Reinforcement Learning's (MARL) application to this problem domain. It introduces a simulation environment, IPMSRL, of a generic Integrated Platform Management System (IPMS) and explores the use of MARL for autonomous cyber defence decision-making on generic maritime based IPMS Operational Technology (OT). OT cyber defensive actions are less mature than they are for Enterprise IT. This is due to the relatively brittle nature of OT infrastructure originating from the use of legacy systems, design-time engineering assumptions, and lack of full-scale modern security controls. There are many obstacles to be tackled across the cyber landscape due to continually increasing cyber-attack sophistication and the limitations of traditional IT-centric cyber defence solutions. Traditional IT controls are rarely deployed on OT infrastructure, and where they are, some threats aren't fully addressed. In our experiments, a shared critic implementation of Multi Agent Proximal Policy Optimisation (MAPPO) outperformed Independent Proximal Policy Optimisation (IPPO). MAPPO reached an optimal policy (episode outcome mean of 1) after 800K timesteps, whereas IPPO was only able to reach an episode outcome mean of 0.966 after one million timesteps. Hyperparameter tuning greatly improved training performance. Across one million timesteps the tuned hyperparameters reached an optimal policy whereas the default hyperparameters only managed to win sporadically, with most simulations resulting in a draw. We tested a real-world constraint, attack detection alert success, and found that when alert success probability is reduced to 0.75 or 0.9, the MARL defenders were still able to win in over 97.5% or 99.5% of episodes, respectively.

cs.LG↗

arXiv2022

Skyrmionic division

Magnetic skyrmions and skyrmion bags are nano-scale spin textures whose stability, size and ease of manipulation make them strong contenders for next generation data and logic applications. Skyrmion bags are composite skyrmions of any integer topological degree and this means they have emergent properties not present in unitary degree skyrmions. Here we present models and theoretical descriptions demonstrating the process of skyrmionic division where a skyrmion or skyrmion bag can be divided into two or more skyrmionic structures. This exciting result could pave the way to entirely new types of skyrmion device in the emerging fields of spintronics and neuromorphic computing.

cond-mat.mes-hall↗

arXiv2021

Magnetic skyrmion binning

When spin polarised electrons flow through a magnetic texture a transfer torque is generated. We examine the effect of this torque on skyrmions and skyrmion bags, skyrmionic structures of arbitrary integer topological degree, in thin ferromagnetic films. Using micromagnetic simulations and analysis from the well known Thiele equation we explore the potential for sorting or binning skyrmions of varying degrees mechanically. We investigate the applicability of the Thiele equation to problems of this nature and derive a theory of skyrmion deflection ordered by topological degree.

cond-mat.mtrl-sci↗

arXiv2018

Composite Skyrmion bags in two-dimensional materials

Skyrmions are particle-like topological excitations, studied in various condensed matter systems and models of high-energy physics (HEP). They occur as stable spin textures in certain planar magnetic materials and as configurations in chiral nematic liquid crystals, having been originally proposed as model of atomic nuclei. Since magnetic Skyrmions can be accelerated with a current, they have the potential to encode bits in low-power magnetic storage devices. Drawing on techniques from HEP, we demonstrate that magnetic and liquid crystal Skyrmions interact like orientation dependent, localised particles, explaining previously observed Skyrmion behaviour. This interaction motivates the construction of Skyrmion bags: textures of high topological degree which we realise experimentally in liquid crystals, and in magnetic materials by computer simulations. These Skyrmion bags configurations are nested multiple Skyrmions, which act like single Skyrmions in pairwise interaction, and under the influence of a current in magnetic materials. These results emphasize equivalent Skyrmion behaviour in different physical systems, and suggest new, high-density magnetic memory storage devices based on Skyrmion bags.

cond-mat.mtrl-sci↗

arXiv2016

Knotted fields and explicit fibrations for lemniscate knots

We give an explicit construction of complex maps whose nodal line have the form of lemniscate knots. We review the properties of lemniscate knots, defined as closures of braids where all strands follow the same transverse (1, $\ell$) Lissajous figure, and are therefore a subfamily of spiral knots generalising the torus knots. We then prove that such maps exist and are in fact fibrations with appropriate choices of parameters. We describe how this may be useful in physics for creating knotted fields, in quantum mechanics, optics and generalising to rational maps with application to the Skyrme-Faddeev model. We also prove how this construction extends to maps with weakly isolated singularities.

math.GT↗

arXiv2016

Weaving knotted vector fields with tunable helicity

We present a general construction of divergence-free knotted vector fields from complex scalar fields, whose closed field lines encode many kinds of knots and links, including torus knots, their cables, the figure-8 knot and its generalizations. As finite-energy physical fields they represent initial states for fields such as the magnetic field in a plasma, or the vorticity field in a fluid. We give a systematic procedure for calculating the vector potential, starting from complex scalar functions with knotted zero filaments, thus enabling an explicit computation of the helicity of these knotted fields. The construction can be used to generate isolated knotted flux tubes, filled by knots encoded in the lines of the vector field. Lastly we give examples of manifestly knotted vector fields with vanishing helicity. Our results provide building blocks for analytical models and simulations alike.

math-ph↗

arXiv2016

The decay of Hopf solitons in the Skyrme model

It is understood that the Skyrme model has a topologically interesting baryonic excitation which can model nuclei. So far no stable knotted solutions, of the Skyrme model, have been found. Here we investigate the dynamics of Hopf solitons decaying to the vacuum solution in the Skyrme model. In doing this we develop a matrix-free numerical method to identify the minimum eigenvalue of the Hessian of the corresponding energy functional. We also show that as the Hopf solitons decay, they emit a cloud of isospinning radiation.

hep-th↗

arXiv2015

Scattering of Nucleons in the Classical Skyrme Model

Classically spinning B=1 Skyrmions can be regarded as approximations to nucleons with quantised spin. Here, we investigate nucleon-nucleon scattering through numerical collisions of spinning Skyrmions. We identify the dineutron/diproton and dibaryon short-lived resonance states, and also the stable deuteron state. Our simulations lead to predictions for the polarisation states occurring in right angle scattering. Videos of our numerical results are shown at http://www.bristoltheory.org/people/david.foster/skyrmevideos/.

nucl-th↗

arXiv2014

Scattering of Skyrmions

In this paper, we present a detailed study of Skyrmion-Skyrmion scattering for two $B=1$ Skyrmions in the attractive channel where we observe two different scattering regimes. For large separation, the scattering can be approximated as interacting dipoles. We give a qualitative estimate when this approximation breaks down. For small separations we observe an additional short-range repulsion which is qualitatively similar to monopole scattering. We also observe the interesting effect of "rotation without rotating" whereby two Skyrmions, whose orientations remain constant while well-separated, change their orientation after scattering. We can explain this effect by following preimages through the scattering process, thereby measuring which part of an in-coming Skyrmion forms part of an out-going Skyrmion. This leads to a new way of visualising Skyrmions. Furthermore, we consider spinning Skyrmions and find interesting trajectories.

hep-th↗

arXiv2014

Domain Decomposition for Heterojunction Problems in Semiconductors

We present a domain decomposition approach for the simulation of charge transport in heterojunction semiconductors. The problem is characterized by a large variation of primary variables across an interface region of a size much smaller than the device scale, and requires a multiscale approach in which that region is modeled as an internal boundary. The model combines drift diffusion equations on subdomains coupled by thermionic emission heterojunction model on the interface which involves a nonhomogeneous jump computed at fine scale with Density Functional Theory. Our full domain decomposition approach extends our previous work for the potential equation only, and we present perspectives on its HPC implementation. The model can be used, e.g., for the design of higher efficiency solar cells for which experimental results are not available. More generally, our algorithm is naturally parallelizable and is a new domain decomposition paradigm for problems with multiscale phenomena associated with internal interfaces and/or boundary layers.

physics.comp-ph↗

arXiv2013

Negative Baryon density and the Folding structure of the B=3 Skyrmion

The Skyrme model is a non-linear field theory whose solitonic solutions, once quantised, describe atomic nuclei. The classical static soliton solutions, so-called Skyrmions, have interesting discrete symmetries and can only be calculated numerically. Mathematically, these Skyrmions can be viewed as maps between to two three-manifolds and, as such, their stable singularities can only be folds, cusps and swallowtails. Physically, the occurrence of singularities is related to negative baryon density. In this paper, we calculate the charge three Skyrmion to a high resolution in order to examine its singularity structure in detail. Thereby, we explore regions of negative baryon density. We also discuss how the negative baryon density depends on the pion mass.

hep-th↗

arXiv2012

Static Hopfion solutions of the extended Skyrme-Faddeev model

We construct non-axially symmetric static soliton solutions, with non-zero topological charges, of an extension of the Skyrme-Faddeev model. The model has an extra quartic-derivative term and we choose its coupling to the Skyrme-term to be negative. We solve the full equations of motion to find numerical solutions with topological charge up to seven and find that the model favours large ring-like solutions.

hep-th↗

arXiv2012

Helical buckling of Skyrme-Faddeev solitons

Solitons in the Skyrme-Faddeev model on R^2xS^1 are shown to undergo buckling transitions as the circumference of the S^1 is varied. These results support a recent conjecture that solitons in this field theory are well-described by a much simpler model of elastic rods.

hep-th↗

arXiv2010

Massive Hopfions

The Skyrme-Faddeev model is a (3+1)-dimensional model which has knotted, string-like, soliton solutions. In this paper we investigate a Skyrme-Faddeev model with an SO(3) symmetry breaking potential. We then rescale this model and take the mass to infinity. This infinite mass model is found to have compact knotted solutions. In all of the investigated massive models we find similar charged solutions as in the usual, m=0, model. We also find that their energies follow a similar power growth as the m=0 model.

hep-th↗

arXiv2009

Baby Skyrmions stabilized by vector mesons

Recent results suggest that multi-Skyrmions stabilized by omega mesons have very similar properties to those stabilized by the Skyrme term. In this paper we present the results of a detailed numerical investigation of a (2+1)-dimensional analogue of this situation. Namely, we compute solitons in an O(3) sigma-model coupled to a massive vector meson and compare the results to baby Skyrmions, which are solitons in an O(3) sigma-model including a Skyrme term. We find that multi-solitons in the vector meson model are surprisingly similar to those in the baby Skyrme model, and we explain this correspondence using a simple derivative expansion.

hep-th↗

arXiv2009

Q-balls, Integrability and Duality

This paper is concerned with the dynamics and interactions of Q-balls in (1+1)-dimensions. The asymptotic force between well-separated Q-balls is calculated to show that Q-balls can be attractive or repulsive depending upon their relative internal phase. An integrable model with exact multi-Q-ball solutions is investigated and found to be of use in explaining the dynamics in non-integrable theories. In particular, it is demonstrated that the dynamics of small Q-balls in a generic class of non-integrable models tends towards integrable dynamics as the charge decreases. Long-lived oscillations of a single Q-ball can also be understood in terms of a deformation of an exact breather solution in the integrable model. Finally, we show that any theory with Q-ball solutions has a dual description in which a stationary Q-ball is dual to a static kink, with an interchange of Noether and topological charges.

hep-th↗