Search arXiv⌕ Search
Home/Archive/arXiv

arXiv · 2610.16865

Controller-Agnostic Runtime Safety Certificates for Tool-Using AI Agents via Data-Driven Robust Reachability

Ali Baheri·Peng Wei
View original source ↗Read source document ↗Export metadata ↓

Abstract

Software agents built on large language models act by issuing tool calls, some of which cannot be undone. To control theory the model is an opaque feedback controller, replaced every few months, whose closed loop cannot be analyzed directly. We propose a runtime filter, or shield, between any such controller and its environment that certifies a bound on the probability of reaching an unsafe condition during a bounded task. Given a predicate abstraction and candidate successor sets, everything else comes from logs: the loop becomes a finite controlled Markov chain, the estimated kernel is surrounded by a distribution-free confidence region, and robust reach-avoid value iteration runs over it. The certificate is probably approximately correct and uniform over controllers respecting the filter, so one model may replace another without recomputation. In all tested datasets the true risk stayed within certificate and budget; in a file-system sandbox the filter stays sound against a hazard the logs barely covered, where a plug-in baseline certifies safety and fails; and it holds seven controllers, three of them open-weights models, to zero unsafe outcomes in 1050 episodes.

Explore related subjects

eess.SYcs.SY

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Ali Baheri, Peng Wei. 2026-10-12. Controller-Agnostic Runtime Safety Certificates for Tool-Using AI Agents via Data-Driven Robust Reachability. https://arxiv.org/abs/2610.16865

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Age of Trust (AoT): A Continuous Verification Framework for Wireless Networks

Zero Trust is a new security vision for 6G networks that emphasises the philosophy of never trust and always verify. However, there is a fundamental trade-off between the wireless transmission efficiency and the trust level, which is reflected by the verification interval and its adaptation strategy. More importantly, the mathematical framework to characterise the trust level of the adaptive verification strategy is still missing. Inspired by this vision, we propose a concept called age of trust (AoT) to capture the characteristics of the trust level degrading over time, with the definition of the time elapsed since the last verification of the target user's trust plus the initial age, which depends on the trust level evaluated at that verification. The higher the trust level, the lower the initial age. To evaluate the trust level in the long term, the average AoT is used. We then investigate how to find a compromise between average AoT and wireless transmission efficiency with limited resources. In particular, we address the bi-objective optimization (BOO) problem between average AoT and throughput over a single link with arbitrary service process, where the identity of the receiver is constantly verified, and we devise a periodic verification scheme and a Q-learning-based scheme for constant process and random process, respectively. We also tackle the BOO problem in a multiple random access scenario, where a trust-enhanced frame-slotted ALOHA is designed. Finally, the numerical results show that our proposals can achieve a fair compromise between trust level and wireless transmission efficiency, and thus have a wide application prospect in various zero-trust architectures.

eess.SY↗
arXiv2026

LiDAL-Assisted RLNC-NOMA in OWC Systems

Optical wireless communication (OWC) is a key enabler for immersive indoor data transmission in future wireless networks. However, managing multi-user interference remains challenging in dense indoor OWC deployments with multiple optical access points (APs) serving multiple users. In this paper, we propose a dual-function OWC system for communication and localization. For data transmission, we design non-orthogonal multiple access (NOMA) combined with random linear network coding (RLNC): NOMA serves multiple users simultaneously via power-domain multiplexing, while RLNC improves decoding robustness under residual noise and processing impairments. The system is assisted by a light detection and localization (LiDAL) module that estimates users' spatio-temporal presence and location to enable dynamic user association. LiDAL also supports channel state information (CSI) estimation in realistic indoor scenarios where CSI may be noisy and/or highly correlated. We evaluate RLNC-NOMA by analyzing the probability of successful decoding and comparing it with conventional NOMA and orthogonal schemes. In addition, we derive the Cramer-Rao lower bound (CRLB) to evaluate the localization accuracy. The results indicate that RLNC-NOMA increases the probability of successful decoding, and that the proposed unbiased location estimator achieves 44% better CSI accuracy than the baseline CSI estimation and improves the overall system performance.

eess.SY↗
arXiv2026

Ensemble-MIX: Enhancing Sample-Efficiency in Multi-Agent RL via Selective Ensemble-Based Exploration

Multi-agent reinforcement learning (MARL) methods have achieved state-of-the-art results on a range of multi-agent tasks. Yet, MARL algorithms typically require significantly more environment interactions than their single-agent counterparts to converge, a problem exacerbated by the difficulty in exploring over a large joint action space and the high variance intrinsic to MARL environments. To tackle these issues, we propose a novel algorithm that combines a decomposed centralized critic with decentralized ensemble learning, incorporating several key contributions. The main component in our scheme is a selective exploration method that leverages ensemble kurtosis. We extend the global decomposed critic with a diversity-regularized ensemble of individual critics and utilize its excess kurtosis to guide exploration toward high-uncertainty states and actions. To improve sample efficiency, we train the centralized critic with a novel truncated variation of the TD($λ$) algorithm, enabling efficient off-policy learning with reduced variance. On the actor side, our suggested algorithm adapts the mixed samples approach to MARL, mixing on-policy and off-policy loss functions for training the actors. This approach balances between stability and efficiency and outperforms purely off-policy learning. The evaluation shows our method outperforms state-of-the-art baselines on standard MARL benchmarks, including a variety of SMAC II maps.

eess.SY↗