Search arXiv⌕ Search

arXiv subjects

Xiang Yu

Publications and source records attributed to Xiang Yu.

At least 19 recordsLinked to original sources

CAPTURER: A Dexterous Aerial Manipulator for Dynamic and Precise Grasping across Diverse Environments

As a representative form of embodied robotic interaction, aerial grasping requires close coordination between the aerial platform and manipulator. Most existing systems perform aerial grasping with static or slowly moving targets under fixed scenarios. Dynamic and precise grasping across different conditions introduces additional challenges, including target motion, localization drift, dynamic coupling, and external disturbances. In this work, we present CAPTURER, a dexterous aerial manipulator for centimeter-level grasping across diverse environments. To achieve the challenging goal, we first develop an onboard perception system for state estimation and target detection. Drift correction and global pose transformation are introduced to improve target localization during flight. A cooperative motion planner is proposed to coordinate the mobility of the aerial platform with the dexterity of the manipulator according to the relative target state. To maintain grasping accuracy under disturbances, we design a disturbance-rejection controller to compensate for dynamic coupling, model uncertainty, and external disturbances. The capability of CAPTURER is validated through indoor and outdoor experiments with both static and moving targets. The results demonstrate that CAPTURER achieves centimeter-level grasping accuracy for a marker pen measuring only 1.5 cm in diameter at flight speeds exceeding 1.5 m/s.

cs.RO↗

Towards Root Memory: Benchmarking and Enhancing Implicit Logical Memory Retrieval for Personalized LLMs

Memory systems are essential for personalized Large Language Models (LLMs). However, retrieval within these systems primarily relies on semantic similarity, potentially missing logically critical memories with limited semantic overlap. We refer to this failure as semantic deflection, which remains insufficiently evaluated by existing benchmarks. To address this gap, we construct IMLogic, a benchmark for implicit logical memory retrieval in long dialogues. Each question is designed around the divergence between semantic and logical relevance, with diagnostic response options that probe semantic deflection, hallucination, and lack of personalization. To help systems utilize associations that are difficult to discover through semantic matching, we introduce root memory, a structured representation that distills reusable, response-guiding logic from user histories through LLM reasoning and grounds it in supporting evidence. We further develop RootMem, a plug-and-play framework that constructs and routes root memories to complement semantic retrieval. Extensive experiments reveal persistent challenges across retrieval methods and memory systems, including substantial preference-driven errors even under full-memory access. RootMem consistently improves performance, demonstrating the potential of structured personalized logic while leaving considerable challenges unresolved. Our benchmark and code are available at https://github.com/ThisIsCosine/IMLogic.

cs.CL↗

Hy-Memory-30B-A3B: Attributed Reinforcement Learning for Long-Term Memory Writing

External-memory systems extend language-model applications beyond a context window, but their quality depends critically on the model executing the write path: deciding what to retain, how precisely to represent it, and how new evidence should update persistent state. Existing frameworks typically place a general-purpose large language model behind framework-specific prompts. This raises serving cost, and a writer specialized for one protocol does not transfer directly to another; a unified model that can operate across established memory frameworks remains largely unexplored. We present Hy-Memory-30B-A3B, a compact long-term-memory writer trained across Mem0, MemOS, and Hy-Memory. Memory On-Policy Distillation teaches framework-specific write protocols on student-generated states; Memory RL then optimizes downstream answerability using dense per-chunk probes, attributed cross-chunk rewards, over-storage controls, and chunk-level GRPO. Carrying policy-written banks across windows keeps training aligned with deployment. On fixed 20% benchmark subsamples, Hy-Memory-30B-A3B ranks first on all four evaluated harnesses, including held-out EverMemOS, with a 55.49% macro average versus 54.62% for Claude Opus 5.

cs.CL↗

Local $W^{2,1}_{p}$ convergence of penalization for time-inconsistent stopping problems

This paper studies the penalization method for a general class of time-inconsistent stopping problems. Inspired by some existing results on penalization for optimal stopping problems, we introduce the penalized PDE problem and the penalized control problem for time-inconsistent stopping problems, uncovering some interesting discrepancy stemming from the time-inconsistency. As the penalization tends to infinity, we develop some novel arguments to rigorously establish the local $W^{2,1}_{p}$ convergence results for the solution of the penalized PDE problem to a solution of the variational inequality associated to the time-inconsistent stopping problem. Under an additional concavity assumption, we further derive the convergence of the penalized time-inconsistent control problem to the time-inconsistent stopping problem. We revisit two examples of time-inconsistent stopping to numerically illustrate the convergence theory.

math.OC↗

Aerial GRIPPER: A Gradient-based Real-time Inverse-game Predictor and Planner

Accurate capture of non-cooperative targets is critical. In an attempt to tackle this intractable challenge, an aerial gripper system integrated with a Gradient-based Real-time Inverse-game Predictor and PlannER (GRIPPER) framework is proposed. The interaction is formulated as a general-sum pursuit-evasion game under incomplete information. Specifically, underlying cost parameters of the target are inferred online, and the open-loop Nash equilibrium (OLNE) strategy is iteratively refined within a receding-horizon loop. To ensure high-frequency execution, a computationally friendly gradient-based inverse-game solver is developed. Without explicit computation of the Hessian inverse, the optimized solution is updated (> 50 Hz) based on implicit differentiation and fast Hessian-vector products. Meanwhile, an anti-disturbance controller is developed to overcome disturbances of uncertain payload and gripper actuation, enabling precise tracking of the planned trajectory and accurate grasping of the target. Simulations and real-world experiments illustrate the superior computational efficiency and task performance of GRIPPER. The task of capturing and delivering a non-cooperative target is accomplished, highlighting the robustness, adaptability, and real-time performance of the framework in highly adversarial scenarios.

cs.RO↗

Elastic localization in finite structures: assessment of the infinite-domain approximation and validity of weakly nonlinear analysis

A common approach to studying elastic localization is to pose the problem on an infinite domain, avoiding explicit treatment of the end conditions. For a finite structure, this approach raises a natural question: how long must the structure be for the infinite-domain approximation to become accurate, and how large is the resulting error? To address this question, we develop a constructive method that provides an explicit length threshold beyond which the approximation error is small and explicitly bounded. Applied to a prototypical model arising from localized buckling of a twisted rod, the method yields the threshold and error bounds analytically. The threshold is found to vary with loading, showing that whether the infinite-domain approximation is appropriate depends on both structural length and loading state. The load-dependent length threshold also clarifies the validity of weakly nonlinear analysis: the finite-domain expansion is appropriate only over a limited range near bifurcation, beyond which the infinite-domain expansion is more appropriate. The method is then applied to the fully nonlinear problem of localized bulging in cylindrical membrane tubes. Numerical evaluation of the model-dependent estimates yields a length threshold and an upper bound on the approximation error, while direct comparisons of the finite- and infinite-domain solutions support these predictions. Together, these results characterize the applicability of the infinite-domain approximation and weakly nonlinear description to elastic localization in finite structures.

cond-mat.soft↗

Inhomogeneous thinning of dielectric membranes under uniaxial tension and electric fields

Dielectric elastomers exhibit rich electromechanical instabilities arising from the coupling between mechanical deformations and electric fields. A widely used approach for analyzing instabilities in dielectric elastomers is the Hessian stability criterion proposed by Zhao and Suo (2007), which identifies the onset of instability of a homogeneous deformation but does not determine how the deformation develops beyond the instability threshold. To address this problem, we investigate dielectric membranes subjected to uniaxial tension and an electric field. Starting from a three-dimensional nonlinear electroelastic formulation, we derive asymptotically consistent reduced models, including a membrane model and a plate model, using the variational-asymptotic method. A linear bifurcation analysis first shows that the Hessian stability criterion is equivalent to a zero-wavenumber bifurcation condition, thereby establishing a direct connection between energy-based stability analysis and bifurcation theory. A subsequent weakly nonlinear analysis demonstrates that the zero-wavenumber bifurcation gives rise to localized necking, manifested as inhomogeneous thinning of the membrane. The weakly nonlinear predictions are further validated by numerical simulations. Furthermore, for the plane-stress configuration considered here, the membrane model accurately captures both the onset of instability and the associated localization behavior, while bending effects remain small. These results identify the deformation associated with the Hessian instability and provide a framework for understanding electromechanical instabilities in dielectric membranes.

cond-mat.soft↗

CARO: Contact-Agnostic Residual Observation for Zero-Shot Robust Quadruped Locomotion

We propose CARO, a contact-agnostic residual observation framework for policy adaptation. CARO embeds a fixed-base Euler--Lagrange model into the reinforcement learning control loop and constructs a torque-level residual observation without requiring torque sensors, explicit contact estimation, or vision-based measurements of the floating-base position and linear velocity. A disturbance observer extracts a structured signal representing dynamics mismatch, while the policy learns to exploit this feedback for online adaptation. CARO is trained under the same terrain, command, and domain-randomization conditions as the nominal policy, without specialized disturbance curricula or additional adaptation supervision. Nevertheless, it achieves substantially improved zero-shot robustness in simulation and sim-to-real transfer tasks involving out-of-distribution payloads, center-of-mass shifts, terrain geometries, abrupt dynamics changes, and elevated-platform landings.

cs.RO↗

A Reinforcement Learning Framework for Some Singular Stochastic Control Problems

We develop a continuous-time reinforcement learning framework for a class of singular stochastic control problems without entropy regularization. The optimal singular control is characterized as the optimal singular control law, which is a pair of regions of time and the augmented states. The goal of learning is to identify such an optimal region via the trial-and-error procedure. In this context, we generalize the existing policy evaluation theories with regular controls to learn our optimal singular control law and develop a policy improvement theorem via the region iteration. To facilitate the model-free policy iteration procedure, we further introduce the zero-order and first-order q-functions arising from singular control problems and establish the martingale characterization for the pair of q-functions together with the value function. Based on our theoretical findings, some q-learning algorithms are devised accordingly and a numerical example based on simulation experiment is presented.

math.OC↗

Physics Filtering Favors the Generalization of Robot Learning

Living organisms exhibit extraordinary adaptability to unseen environments through their intrinsic physical structures and lifelong feedback-driven learning. Endowing robots with comparable generalization is critical for reliable operation in the real world. While recent approaches attempt to improve generalization by scaling training data, such strategies remain impractical for robotics, where collecting real-world demonstrations at the scale of large language models is prohibitively costly and slow. Contrary to this reliance on massive datasets, we show that robots can generalize effectively under dynamics uncertainties even with limited training data by leveraging a feedback mechanism, namely PhyFilter, that corrects learning outputs with physics-filtered learning residuals. PhyFilter operates as a lightweight, model-agnostic module whose parameters can be automatically optimized through an auto-learning algorithm, eliminating manual tuning and enabling seamless integration with diverse robot policies. We validate PhyFilter across four representative robotic systems, demonstrating that it enables quadruped robots to generalize to unseen terrains, payload variations, and speed ranges; drones to flight under unseen wind disturbances; aerial manipulators to achieve centimeter-level in-air capture despite wind and mass uncertainties; and acceleration differentiators to remain robust with distribution shift. These results show that physics-filtered feedback can serve as a powerful alternative to massive data scaling.

cs.RO↗

Unified continuous-time q-learning for mean-field game and mean-field control problems

This paper studies the continuous-time q-learning in mean-field jump-diffusion models in a setting where the environment simulator does not provide direct access to the population distribution. We propose the integrated q-function in decoupled form (decoupled Iq-function) and establish its martingale characterization, which provides a unified policy evaluation rule for both mean-field game (MFG) and mean-field control (MFC) problems. Moreover, we consider the learning procedure where population distribution is updated based on the representative agent's state values. Depending on the task to solve the MFG or MFC problem, we can employ the decoupled Iq-function differently to characterize the mean-field equilibrium policy or the mean-field optimal policy respectively. Based on these theoretical findings, we devise a unified parametric q-learning algorithm for both MFG and MFC problems by utilizing test policies and the averaged martingale orthogonality condition. In two applications within and beyond LQ framework, we illustrate the effectiveness and efficiency of our unified parametric q-learning algorithm for both MFG and MFC learning tasks.

math.OC↗

Continuous-time reinforcement learning for optimal switching over multiple regimes

This paper studies the continuous-time reinforcement learning (RL) for optimal switching problems across multiple regimes. We consider a type of exploratory formulation under entropy regularization where the agent randomizes both the timing of switches and the selection of regimes through the generator matrix of an associated continuous-time finite-state Markov chain. We establish the well-posedness of the associated system of Hamilton-Jacobi-Bellman (HJB) equations and provide a characterization of the optimal policy. The policy improvement and the convergence of the policy iterations are rigorously established by analyzing the system of equations. We also show that the value function in the exploratory formulation converges to the one in the classical formulation as the temperature parameter vanishes. Finally, a model-free reinforcement learning algorithm is devised and implemented by invoking the policy evaluation based on the martingale characterization. Our numerical examples with financial applications illustrate the effectiveness and efficiency of the proposed RL algorithm.

math.OC↗

Mean-field game of mean-variance portfolio optimization with peer-based risk aversion

This paper investigates a class of mean-field game (MFG) for mean-variance (MV) portfolio optimization, highlighting a new type of relative performance encoded by the peer-based risk aversion. Specifically, the risk aversion is formulated as a piecewise form that depends on whether the individual's wealth is above or below the population average, leading to a time-inconsistent MFG. Our goal is to seek a mean-field equilibrium, characterized by a forward-backward stochastic differential equation (FBSDE) system and a mean-field consistency condition. The new challenge stems from the discontinuous coefficients induced by the piecewise risk aversion. In response, we first introduce a smooth regularization technique to establish the existence of a solution to the discontinuous multidimensional FBSDE; this solution then yields the existence of an intra-personal equilibrium for the representative agent. Finally, we conclude the existence of the mean-field equilibrium in the time-inconsistent MFG by invoking fixed-point arguments and convergence analysis as the smoothing regularization vanishes.

q-fin.MF↗

Reinforcement learning for irreversible reinsurance problems: the randomized singular control approach

This paper studies the continuous-time reinforcement learning for stochastic singular control with the application to an infinite-horizon irreversible reinsurance problem. The singular control is equivalently characterized as a pair of regions of time and the augmented states, called the singular control law. To encourage the exploration in the learning procedure, we propose a randomization method by considering an auxiliary singular control and entropy regularization. The exploratory singular control problem is formulated as a two-stage optimal control problem, in which the time-inconsistency issue arises in the outer problem. Existence of equilibrium singular control law for the time-inconsistent outer problem is rigorously established. Taking advantage of the solution structure, we utilize a proper parameterization and neural networks to devise the actor-critic reinforcement learning algorithm. In the numerical experiment, we show the superior convergence of parameter iterations based on the randomized equilibrium policy and illustrate how the exploration may advance the learning performance.

math.OC↗

A VLM-Enhanced Framework for Comprehensive Traffic Sign Condition Assessment Integrating Daytime Visual Performance and Nighttime Retroreflectivity Evaluation

Traffic signs are crucial components of road safety, serving as visual tools under all lighting conditions. The Manual on Uniform Traffic Control Devices (MUTCD) specifies daytime visual factors such as legibility and color contrast, and nighttime retroreflectivity requirements. Traditional assessment methods rely on manual inspections, which the Federal Highway Administration (FHWA) notes are subjective, labor-intensive and pose safety concerns, while retroreflectometers are expensive and unaffordable for smaller agencies. Most existing studies focus on either daytime factors or nighttime retroreflectivity but rarely integrate both aspects comprehensively. This study develops a novel framework that systematically evaluates traffic signs through integrated daytime-nighttime assessment. The methodology employs three fine-tuned Vision Language Models (VLMs) for daytime visual performance assessment across four key factors: legibility, color, surface and shape integrity, and surrounding environment conditions. VLM predictions are converted to numerical scores through sentiment analysis and Contrastive Language-Image Pre-Training (CLIP) scoring, while nighttime performance is assessed using LiDAR-derived retroreflectivity following established calibration procedures. The framework integrates these components into a comprehensive Sign Condition Index (SCI) for maintenance guidance. Evaluation results demonstrated that LLaVA and Qwen outperformed InternVL, achieving bidirectional cosine similarity scores of 0.67-0.76 across all factors. Among 462 validated traffic signs, 68 were flagged by the proposed framework as requiring immediate replacement due to inadequate retroreflectivity performance. This research provides a cost-effective alternative to traditional manual inspections for comprehensive traffic sign condition assessment.

cs.CV↗

The Information Content of Quasar Variability Light Curves: How Well Can we Infer Stochastic Model Parameters?

Quasar variability, driven by multi-scale physical processing within a relativistic accretion disk, is commonly modelled with stochastic time series models. The simplest of these is the Damped Random Walk (DRW), also known as the Ornstein-Uhlenbeck (OU) process. Here, we demonstrate that, when fitting such a model to quasar light curve data, the mean of the light curve, $μ$, should not be fixed (which is the typical approach), as this leads to overconfident inferences about the variability timescale $τ$, with substantially underestimated uncertainties. However, the short term volatility parameter $η$ is typically very well constrained from short light curves. Through simulations, we compute information theoretic quantities such as the conditional entropy and the mutual information, confirming that light curves provide much more information about $η$ than about $τ$. As a result, we recommend that future quasar variability studies focus on $η$ rather than $τ$. To demonstrate this approach, we fit a hierarchical Bayesian regression model for $η$ as a function of bolometric luminosity and rest wavelength to a dataset of 570 light curves measured over decades. We perform the fit using a likelihood function that uses the light curves directly, rather than using intermediate $η$ values from individual light curve fits. We find that volatility decreases as a function of both bolometric luminosity and rest wavelength. The volatility also decreases more steeply with redshift than time dilation alone would suggest, pointing to an increase in intrinsic volatility as quasars evolve over cosmic time.

astro-ph.GA↗

Exclusion of Infinite Spin for N-body problem in $\mathbb{R}^d$

We show that there is no infinite spin at total collisions for $-κ$-homogeneous N-body problem in higher dimensional Euclidean space $\mathbb{R}^d$, in which $0 < κ< 2$ ($κ= 1$ the Newtonian case), provided the limiting normalized central configuration is isolated and is of dimension d or d - 1. In the Newtonian case $κ= 1$, this extends the work of Moeckel-Montgomery to $d \ge 3$ and in the d = 3 case offers a different approach as compared to the current preprint of Pinzari-Zgliczynski.

math.DS↗

Mean Field Control with Poissonian Common Noise: A Pathwise Compactification Approach

This paper contributes to the compactification approach to study mean-field control problems with Poissonian common noise. To overcome the lack of compactness and continuity issues caused by common noise, we exploit the point process representation of the Poisson random measure with finite intensity and propose a pathwise formulation in a two-step procedure by freezing a sample path of the common noise. In the first step, we establish the existence of optimal relaxed controls in the pathwise formulation as if common noise is absent, but with finite deterministic jumping times. The second step plays the key role in our approach, which is to aggregate the optimal solutions in the pathwise formulation over all sample paths of common noise and show that it yields an optimal solution in the original model. To this end, with the help of concatenation techniques, we first develop a pathwise superposition principle in the model with deterministic jumping times, drawing a relationship between the pathwise relaxed control problem and the pathwise measure-valued control problem. We then further bridge the equivalence among different problem formulations and verify that the constructed solution under aggregation is indeed optimal in the original problem.

math.OC↗