Search arXiv⌕ Search

arXiv · 2610.07501

Uncertainty-Aware Vision-Based Autonomous Aerial Refueling

Abstract

Probe-and-drogue refueling (PDR) requires accurate terminal alignment of a receiver probe with an uninstrumented, dynamically moving drogue despite uncertainty in both relative-state estimation and closed-loop motion. Existing vision-based docking approaches provide relative-state estimates, but generally do not quantify estimation and operational uncertainty in a way that informs the control authority required for robust docking performance. We present an uncertainty-aware vision-based PDR docking architecture that fuses keypoint-based drogue measurements, differential GPS, and avionics in an extended Kalman filter. Split conformal calibration characterizes near-contact error in the fused probe-to-drogue displacement estimate, while a covariance-based operational uncertainty quantification designs position-dispersion limits along with corrective-command variance budgets under modeled handoff variability and disturbances. The resulting uncertainty statistics define geometric and command margins for a range-conditioned deterministic predictive controller. In high-fidelity FlightGear/JSBSim simulations with four controller variants and 50 runs per variant, the combined-margin controller achieved 45/50 centered basket-plane crossings versus 34/50 for nominal MPC. Median planar crossing error decreased from 0.231 to 0.175~$\mathrm{m}$ and the empirical 90th percentile from 0.403 to 0.286~$\mathrm{m}$, while the roll-command RMS increased from 0.22$^\circ$ to 0.48$^\circ$.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Minhyuk Jang, Thinh Nguyen, Vivek Khatana, Sandeep Banik, Naira Hovakimyan, Petros G. Voulgaris. 2026-10-05. Uncertainty-Aware Vision-Based Autonomous Aerial Refueling. https://arxiv.org/abs/2610.07501

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Traffic State Prediction and Control Using a Koopman Operator Framework with Polynomial Observables

In this paper, we develop a Koopman operator framework for modeling and control of traffic flow governed by the Lighthill--Whitham--Richards (LWR) conservation law. We show that the nonlinear dynamics induced by the Greenshields flow--density relation naturally motivate a dictionary of polynomial observables, while the controlled dynamics become bilinear in the lifted Koopman coordinates. A reduced-order Koopman model is identified from spatio-temporal traffic-density snapshots and used as the prediction model in a model predictive control (MPC) framework for ramp metering. The resulting Koopman-MPC is compared with two predictive control baselines that use, respectively, a fixed linearized LWR model and the nonlinear finite-volume LWR model. In a one-hour freeway experiment, the Koopman-based controller maintains the traffic density below the critical Greenshields value and closely reproduces the behavior of the nonlinear PDE-based MPC, with a maximum-density difference below 1%. The Koopman predictor also reduces the mean online model-evaluation cost by approximately one order of magnitude relative to the nonlinear PDE predictor. In contrast, the linearized LWR predictor is computationally cheaper but exhibits substantially larger prediction errors and yields a more conservative metering policy. These results demonstrate that the analytical structure of the nonlinear traffic conservation law can be exploited to construct an interpretable data-driven surrogate for efficient traffic prediction and control

eess.SY↗

SAFTER: Safety-Aware Filtering Through Explicit Recoverability for Robust Reinforcement Learning under Distribution Shift

Learning safe policies that generalize to unseen environments is difficult under bounded actuation, where an unsafe decision may become unrecoverable. Conventional control barrier function (CBF) filters enforce only instantaneous safety and ignore future recoverability. We propose SAFTER (Safety-Aware Filtering Through Explicit Recoverability), which embeds a differentiable, closed-form backup-CBF filter into Soft Actor-Critic training. SAFTER unifies current safety, finite-horizon backup safety, terminal recoverability, and input admissibility into a single differentiable certificate. Its CBF condition yields an exact minimum-intervention projection without iterative online optimization. In quadruped navigation, SAFTER reaches 90% training success with 30.6% fewer transitions than Vanilla SAC and 34.1-35.1% fewer than current-state CBF-filtered SAC baselines. Across unseen simulated environments, SAFTER improves success by up to 42.4 and 61.4 percentage points over the state-of-the-art methods CBF-RL and SEA-Nav, respectively, and achieves 73.3% and 76.7% success on two real-world navigation maps. Ablations identify accurate differentiation through the safety filter as a key contributor to robustness, in which replacing the projection Jacobian with the identity approximation reduces success rate in a High-Shift environment from 61.4% to 6.2%. These results show that recoverability-aware filtering serves as both a runtime safety mechanism and a learning mechanism for sample-efficient, robust policies.

eess.SY↗

A Decade of Learning-Based Control: From Theoretic Foundations to Practical Deployment

Motivated by ten years of Learning-Based Control Invited Sessions at the IEEE Conference on Decision and Control (CDC), this tutorial paper reviews key advances at the intersection of machine learning and control. We focus on methods that combine the flexibility of machine learning techniques with the structure and theoretical foundations of control to design autonomous systems that are capable, reliable, and safe. We first introduce core notions for establishing stability and safety guarantees, then review approaches that learn dynamics models to improve control under uncertainty, and finally discuss data-driven methods that directly synthesize or learn policies, including reinforcement learning, imitation learning, and Bayesian optimization. We further discuss representative applications and open challenges. The goal is to provide an accessible entry point to the field and to support continued progress toward reliable learning-based control in real-world systems. To support learning and practical exploration, we share implementations and illustrative examples along with our discussion, together with additional resources on our website: https://learning-based-control.github.io/tutorial/.

eess.SY↗