Sudhir Pratap Yadav | Search arXiv

arXiv2026

AnchorFlow-VIO: Fixed-Template Monocular Visual-Inertial Odometry on LaMAria

We present AnchorFlow-VIO, an open-source Basalt-derived monocular visual-inertial odometry system, and evaluate a uniform configuration on LaMAria. The system uses one grayscale camera and one IMU, combining factory IMU correction, a fixed timing adjustment, windowed initialization and fixed-template patch tracking. Server evaluation of all 63 test recordings yields control-point scores of 47.2, 37.1, 24.8, 35.1 and 15.6 for Short, Medium, Long, Low light and Moving platform. Test pose recalls at 5 m are 84.6%, 69.1%, 53.9% and 62.9% for the four categories reporting dense recall. On ten training recordings, mean control-point score is 41.38 and all 265,694 image timestamps receive poses, including 204 filled poses. One training platform recording diverges and scores zero. A paired four-record comparison favors fixed over rolling templates on three recordings, while reversing that ranking on the fourth. Increasing feature density also yields mixed results. Ten fresh runs at prospectively fixed 30 s and 120 s offsets expose substantial start sensitivity: a low-light recording scores 6.14 at the earlier start and 42.00 at the later start. These results characterize the limits of the frozen system and show why complete output, feature counts and selected successful runs are insufficient evidence of robust localization. Source code, frozen configuration and reproducible submission tools are publicly available; training ablations are reported separately from the submitted test evaluation.

cs.RO↗

arXiv2023

Learning Vision-based Robotic Manipulation Tasks Sequentially in Offline Reinforcement Learning Settings

With the rise of deep reinforcement learning (RL) methods, many complex robotic manipulation tasks are being solved. However, harnessing the full power of deep learning requires large datasets. Online-RL does not suit itself readily into this paradigm due to costly and time-taking agent environment interaction. Therefore recently, many offline-RL algorithms have been proposed to learn robotic tasks. But mainly, all such methods focus on a single task or multi-task learning, which requires retraining every time we need to learn a new task. Continuously learning tasks without forgetting previous knowledge combined with the power of offline deep-RL would allow us to scale the number of tasks by keep adding them one-after-another. In this paper, we investigate the effectiveness of regularisation-based methods like synaptic intelligence for sequentially learning image-based robotic manipulation tasks in an offline-RL setup. We evaluate the performance of this combined framework against common challenges of sequential learning: catastrophic forgetting and forward knowledge transfer. We performed experiments with different task combinations to analyze the effect of task ordering. We also investigated the effect of the number of object configurations and density of robot trajectories. We found that learning tasks sequentially helps in the propagation of knowledge from previous tasks, thereby reducing the time required to learn a new task. Regularisation based approaches for continuous learning like the synaptic intelligence method although helps in mitigating catastrophic forgetting but has shown only limited transfer of knowledge from previous tasks.

cs.RO↗