SAFER-Nav: Enhancing Safety for Visual Robot Navigation via Segmentation-Aware Fine-Tuning

Abstract

Vision-based navigation models, particularly foundation models, generate viable trajectories from RGB observations alone. However, even state-of-the-art transformer- and diffusion-based policies struggle to generalize in unfamiliar deployment environments containing unseen obstacles or shifted conditions. The resulting trajectories often remain goal-directed but unsafe. Existing efforts improve safety through external trajectory correction or internal geometric priors, yet the resulting policies are not trained to explicitly represent obstacle boundaries or traversable free-space structure. To address this, we propose a navigation model that incorporates these structures directly into the policy via fine-tuning and is designed for transformer-based RGB navigation policies. Across three robot platforms, two indoor environments, and static and dynamic obstacle scenarios, our method reduces collisions per run from 1.76 to 0.20 and raises the goal arrival rate from 42% to 93% relative to ViNT, with consistent gains over NoMaD and their CARE-augmented variants. Project page: https://paper-demo.github.io/SAFER_Nav/