Gaussian process model kernels for noisy optimization in variational quantum algorithms

Abstract

Variational Quantum Algorithms (VQAs) aim at solving classical or quantum optimization problems by optimizing parametrized trial states on a quantum device, based on the outcomes of noisy projective measurements. The associated optimization process benefits from an accurate modeling of the cost function landscape using Gaussian Process Models (GPMs), whose performance is critically affected by the choice of their kernel. Here we introduce trigonometric kernels, inspired by the observation that typical VQA cost functions display oscillatory behaviour with only few frequencies. Appropriate scores to benchmark the reliability of a GPM are defined, and a systematic comparison between different kernels is carried out on prototypical problems from quantum chemistry and combinatorial optimization. We further introduce RotoGP, a sequential line-search optimizer equipped with a GPM, and test how different kernels can help mitigate noise and improve optimization convergence. Overall, we observe that the trigonometric kernels show the best performance in most of the cases under study.