Search arXiv⌕ Search
Home/Archive/arXiv

arXiv · 2610.20474

AdaRSI: On-Demand Recursive Self-Improvement for Embodied Agents

Peidong Wang·Ying Chang·Zhiming Ma·Xiaocui Yang·Shi Feng·Daqi Liu·Yuzhe Yang·Xu Cao·Chuang Wang·Jian Su·Daling Wang
View original source ↗Read source document ↗Export metadata ↓

Abstract

Pretrained vision-language-action models (VLAs) often fail midway through unseen long-horizon tasks. Recursive self-improvement (RSI) offers a remedy, but embodied RSI methods either refine the harness around a frozen executor and so cannot add a missing motion, or train the executor on persistent failures without asking whether a failure lies in how the executor is called or in what it can do. We ask when a self-improving embodied system should change the weights of its executor, and propose AdaRSI, an on-demand RSI framework for embodied agents. A coding agent first improves its skills and harness, then attributes persistent failures by retrying failing sub-steps from saved states, and fine-tunes only the sub-steps that remain unreliable, with demonstrations it collects itself and experience carried over from earlier tasks. On all 50 target tasks of RoboCasa365, with GR00T N1.5 as the executor and no human demonstrations, AdaRSI improves the VLA on all three suites and raises its success on unseen composite tasks from 4.6% to 13.8%. Compared with fine-tuning every sub-step, it reaches slightly higher success while using only 28% of the GPU time and 22% of the self-collected demonstrations, and fine-tuning without a harness trains more yet gains far less.

Explore related subjects

cs.CLcs.RO

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Peidong Wang, Ying Chang, Zhiming Ma, Xiaocui Yang, Shi Feng, Daqi Liu, Yuzhe Yang, Xu Cao, Chuang Wang, Jian Su, Daling Wang. 2026-10-14. AdaRSI: On-Demand Recursive Self-Improvement for Embodied Agents. https://arxiv.org/abs/2610.20474

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Learning From How Humans Correct

In industry NLP application, our manually labeled data has a certain number of noisy data. We present a simple method to find the noisy data and relabel them manually, meanwhile we collect the correction information. Then we present novel method to incorporate the human correction information into deep learning model. Human know how to correct noisy data. So the correction information can be inject into deep learning model. We do the experiment on our own text classification dataset, which is manually labeled, because we need to relabel the noisy data in our dataset for our industry application. The experiment result shows that our learn-on-correction method improve the classification accuracy from 91.7% to 92.5% in test dataset. The 91.7% accuracy is trained on the corrected dataset, which improve the baseline from 83.3% to 91.7% in test dataset. The accuracy under human evaluation achieves more than 97%.

cs.CL↗
arXiv2026

LLMR: Knowledge Distillation with a Large Language Model-Induced Reward

Large language models have become increasingly popular and demonstrated remarkable performance in various natural language processing (NLP) tasks. However, these models are typically computationally expensive and difficult to be deployed in resource-constrained environments. In this paper, we propose LLMR, a novel knowledge distillation (KD) method based on a reward function induced from large language models. We conducted experiments on multiple datasets in the dialogue generation and summarization tasks. Empirical results demonstrate that our LLMR approach consistently outperforms traditional KD methods in different tasks and datasets.

cs.CL↗
arXiv2026

C-VARC: A Large-Scale Chinese Value Rule Corpus for Value Alignment of Large Language Models

Aligning LLMs with Chinese values requires culturally grounded resources that connect abstract values to concrete behavioral guidance. We introduce C-VARC, a Chinese Value Rule Corpus containing 257,609 Rules of Thumb (RoTs) organized into three dimensions, 12 core values, and 50 derived values. Among them, 36,000 rules underwent independent human review by two annotators (Cohen's kappa>0.85), with disagreements adjudicated by a third. C-VARC supports reusable rule-driven pipelines for both value evaluation and model alignment. Compared with abstract-value guidance, RoT guidance produces greater semantic and character-level n-gram diversity. Across five non-political sensitive themes, the seven-model average selection rate for C-VARC-consistent options is at least 72.0%, while five Chinese annotators show overall rates of at least 87.5%. Conflicting RoT pairs further enable the construction of 404,505 moral dilemmas, with 7,191 of 10,998 evaluated cases eliciting cross-model disagreement. For alignment, C-VARC-Query consistently outperforms matched Value-only supervision on CMoralEval across both Qwen3-8B and Llama-3.1-8B-Instruct, with average gains of 2.97 and 12.82 percentage points, respectively, and positive paired gains across all three seeds for both backbones. It also improves CValues and C-Eval over Value-only supervision on both backbones. C-VARC thus provides a scalable Chinese normative resource for constructing both value-evaluation and alignment supervision.

cs.CL↗