arXiv · 2611.09734
GuardrailAgent: An Agentic Framework for Jailbreak Defense
Abstract
Despite undergoing safety training to align with human values, large language models (LLMs) remain vulnerable to jailbreak attacks that circumvent built-in safeguards and elicit malicious behaviors given by the adversary. Existing defenses are mostly static and fail to adapt to new or unknown attack strategies, providing limited resilience. To address these, we propose a multi-agent defense framework, GuardrailAgent, that offers adaptive, end-to-end protection. The system autonomously gathers and summarizes attack characteristics into a continuously updated knowledge base that supports both input- and output-side detection. A feedback module integrates misclassified cases for iterative improvement at minimal cost. Tested on over ten representative jailbreaks, the framework achieved a 93.1% input-side detection rate, 93.9% overall detection, and a 95.8% F1 score, while rapidly adapting to unseen attacks. These results demonstrate GuardrailAgent's outstanding capability to maintain LLM safety in the face of evolving jailbreak tactics.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Tianze Chang, Junjie Chu, Yixin Wu, Michael Backes, Yang Zhang. 2026-11-06. GuardrailAgent: An Agentic Framework for Jailbreak Defense. https://arxiv.org/abs/2611.09734
Cite the original work for its findings. Save a collection to share your selection of sources.