Annealed sampling of diffusion models in lattice field theory

Abstract

Machine learning methods have recently gained increasing interest as possible means of solving critical slowing down in lattice field theory, with particular emphasis on sampling methods using field transformations such as normalizing flows, annealing/out-of-equilibrium methods, and diffusion models. Annealing methods provide appealing polynomial scaling and exactness guarantees, while diffusion models use a simple and efficient score-matching training procedure. This work explores a method combining these benefits, first training an energy-based diffusion model using score matching, then sampling using either stochastic normalizing flows (SNFs) or flow-transformed replica exchange (T-REX). The choice of sampling method can be made after training the diffusion model; the theoretical properties of SNFs and T-REX and their relative trade-offs are discussed. Numerical results are presented for scalar field theory and the O(3) non-linear sigma model, using a class of local-footprint energy models with efficient gradient and divergence calculations. Sampling from the trained models follows predicted exactness and scaling properties, and significantly improves over sampling methods without a learned component.