arXiv · 2603.17137
Integral Quadratic Constraints for Repeated ReLU
Abstract
This paper presents a new dynamic integral quadratic constraint (IQC) for the repeated Rectified Linear Unit (ReLU). These dynamic IQCs can be used to analyze stability and induced $\ell_2$-gain performance of discrete-time, recurrent neural networks (RNNs) with ReLU activation functions. These analysis conditions can be incorporated into learning-based controller synthesis methods, which currently rely on static IQCs. We show that our proposed dynamic IQCs for repeated ReLU form a superset of the dynamic IQCs for repeated, slope-restricted nonlinearities. We also prove that the $\ell_2$-gain bounds are nonincreasing with respect to the horizon used in the dynamic IQC filter. A numerical example using a simple (academic) RNN shows that our proposed IQCs lead to less conservative bounds than existing IQCs.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Sahel Vahedi Noori, Bin Hu, Geir Dullerud, Peter Seiler. 2026-03-17. Integral Quadratic Constraints for Repeated ReLU. https://arxiv.org/abs/2603.17137
Cite the original work for its findings. Save a collection to share your selection of sources.