Search arXiv⌕ Search

arXiv subjects

Yong Li

Publications and source records attributed to Yong Li.

At least 91 records · Page 5Linked to original sources

Geo-Embed: Towards Unified Multimodal Embeddings for Urban Understanding

Geospatial and urban applications increasingly require models to compare heterogeneous evidence across street-view imagery, remote-sensing observations, text descriptions, region proposals, and temporal change cues. However, existing multimodal embedding models and benchmarks are still largely designed and evaluated around general-purpose image-text matching, leaving unclear whether unified embedding space can support heterogeneous geospatial tasks involving spatial relationships, fine-grained semantics, and temporal changes. To address this gap, we make three key contributions. First, we introduce GeoMEB, a large-scale multimodal embedding benchmark that standardizes 45 urban evaluation tasks across retrieval, visual question answering, change detection, classification, and visual grounding, together with training collections comprising 1.32M examples and 286K evaluation queries. Second, we present Geo-Embed, a unified embedding model that adapts a shared vision-language backbone to instruction-conditioned query-target matching over heterogeneous geospatial inputs, including single images, multiple images, text, regions, and masks. On GeoMEB, Geo-Embed achieves the strongest overall performance among representative multimodal embedders, with a 15.3% relative improvement over the strongest baseline. These results motivate future geospatial embedders that organize training and evaluation around explicit query-target relations, including semantic, cross-view, region-level, and temporal correspondence.

cs.CV↗

SIGNPOST-Bench: Benchmarking Text-Vision Conflict Resolution in Multimodal Large Language Models

Multimodal large language models (MLLMs) make grounded predictions in real-world scenes by combining visual and textual cues, yet existing benchmarks rarely reveal how they arbitrate between these evidence sources when they conflict. We introduce SIGNPOST-Bench, a controlled counterfactual benchmark for evaluating text-vision conflict resolution. Each source image is transformed into a counterfactual quintuplet of Original, Blank, Similar, Random, and Adversarial variants. Synthetic, localized scene-text interventions are designed to preserve non-textual content, enabling paired measurements of changes in localization performance and directed shifts toward geographic targets introduced by conflicting text. SIGNPOST-Bench contains 5,111 counterfactual groups and 25,555 image variants from four datasets. We evaluate 20 MLLMs from seven providers. Compared with Original images, Adversarial variants raise median localization error from 282 km to 1,347 km, a 4.8-fold increase. Among geocodable adversarial samples, 6.5-20.1% of predictions lie less than 50 km from the injected target across models, and every evaluated model exhibits a positive mean paired reduction in target distance from Blank to Adversarial. Compatible, unrelated, and conflicting text replacements produce distinct effects on model predictions, while clean-input localization performance does not fully predict robustness to conflicting text. These results establish visual geolocation as a continuous diagnostic of scene-text arbitration and provide a controlled framework for evaluating how MLLMs resolve conflicting multimodal evidence.

cs.CV↗

SVRepair: Structured Visual Reasoning for Automated Program Repair

Large language models (LLMs) have recently been applied to Automated Program Repair (APR), yet most existing approaches remain unimodal and fail to use diagnostic signals contained in visual artifacts such as screenshots and control-flow graphs. In practice, many bug reports convey critical information visually (e.g., layout breakage or missing widgets), but directly using such dense visual inputs often causes context loss and noise, making it difficult for MLLMs to ground visual observations into precise fault localization and executable patches. To bridge this semantic gap, we propose \textbf{SVRepair}, a multimodal APR framework with Structured Visual Representation (SVR). SVRepair first fine-tunes a vision-language model, SVR, to uniformly transform heterogeneous visual artifacts into a \emph{semantic scene graph} that captures GUI elements and their structural relations (e.g., hierarchy), providing normalized, code-relevant context for downstream repair. Building on the graph, SVRepair drives a coding agent to localize faults and synthesize patches, and further introduces an iterative visual-artifact segmentation strategy that progressively narrows the input to bug-centered regions to suppress irrelevant context and reduce hallucinations. Across primary repository-level APR benchmarks, SVRepair resolves \textbf{186/517} SWE-Bench M instances (\textbf{35.98\%} over all instances; \textbf{36.47\%} over submitted runs) and \textbf{4/19} visual OmniGIRL instances (\textbf{21.05\%}). On supplementary structured multimodal code reasoning benchmarks, SVRepair reaches \textbf{38.02\%} on MMCode and \textbf{95.73\%} on CodeVision. Code is available at https://github.com/codefuse-ai/CodeFuse-SVR.

cs.SE↗

Laskar's frequency map analysis revisited

In this paper, we establish the exponential convergence of Laskar's pioneering frequency map analysis, strictly improving upon classical polynomial bounds. By utilizing appropriately chosen weighting functions, we achieve such exponential rates in the analytic quasi-periodic regime for frequency vectors satisfying Diophantine or Brjuno nonresonance conditions. Furthermore, we extend the theoretical framework beyond the analytic quasi-periodic regime into the analytic almost periodic setting. By employing and generalizing Bourgain's framework, we accommodate a much broader class of anisotropic spatial structures. These results yield the first unified theory of exponential convergence for frequency map analysis, revealing the interplay among analyticity, spatial structures, nonresonance conditions, the choice of weighting functions, and convergence rates. This framework has important implications for applications in fields including celestial mechanics. Moreover, the novel techniques developed herein yield new insights into the study of weighted Birkhoff averages.

math.DS↗

WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivity

Controllable video generation models are increasingly being developed as world models. Accordingly, evaluating them in this role extends beyond the apparent appearance of generated videos to the inherent reactivity of the worlds they depict: the ability to infer from the scene state how the world should react and to generate plausible consequences not explicitly described in the input. Yet existing benchmarks mainly assess visual quality or explicit instruction fulfillment by checking whether requested actions and interaction outcomes are realized, leaving inherent reactivity underexamined. We introduce WorldExam, a hierarchical diagnostic benchmark spanning four levels: Visual Quality, Control Adherence, Spatial Consistency, and World Reactivity. It comprises 1,474 cases across eight dedicated tasks and supports unified evaluation of camera-, action-, and language-driven model paradigms. The World Reactivity level evaluates scene-conditioned reactions and goal-directed behaviors beyond what is explicitly specified in the input. Evaluation of 20 representative models reveals a clear capability split. Camera-driven models excel at camera control, but their interfaces do not support dynamic interaction; action-driven models control subjects more precisely but often leave the world unresponsive; and language-driven models perform better on interaction but follow complex controls less faithfully. No model combines broad task coverage with consistently strong performance, showing that high visual quality and explicit instruction fulfillment do not guarantee inherent reactivity.

cs.CV↗

DehazeGS: Seeing Through Fog with 3D Gaussian Splatting

Current novel view synthesis methods are typically designed for high-quality and clean input images. However, in foggy scenes, scattering and attenuation can significantly degrade the quality of rendering. Although NeRF-based dehazing approaches have been developed, their reliance on deep fully connected neural networks and per-ray sampling strategies leads to high computational costs. Furthermore, NeRF's implicit representation limits its ability to recover fine-grained details from hazy scenes. To overcome these limitations, we propose learning an explicit Gaussian representation to explain the formation mechanism of foggy images through a physically forward rendering process. Our method, DehazeGS, reconstructs and renders fog-free scenes using only multi-view foggy images as input. Specifically, based on the atmospheric scattering model, we simulate the formation of fog by establishing the transmission function directly onto Gaussian primitives via depth-to-transmission mapping. During training, we jointly learn the atmospheric light and scattering coefficients while optimizing the Gaussian representation of foggy scenes. At inference time, we remove the effects of scattering and attenuation in Gaussian distributions and directly render the scene to obtain dehazed views. Experiments on both real-world and synthetic foggy datasets demonstrate that DehazeGS achieves state-of-the-art performance. visualizations are available at https://jz-y-cn.github.io/DehazeGS/

cs.CV↗

From Scoring to Acting: Outcome-Verified Comparative Self-Distillation for LLM Agents

Recent work on LLM agents is shifting from external capability elicitation to capability internalization, enabling agents to retain useful skills without retrieval at inference time. On-policy self-distillation (OPSD) offers a promising direction, but many existing methods typically supervise students by scoring actions along student-generated trajectories. Such supervision has two limitations: teacher preferences are not validated by environment outcomes, and action-level scores underuse information from student rollouts, teacher rollouts, and their behavioral relationship. We therefore advocate outcome-verified teacher supervision and comparative learning over teacher-student trajectories. Based on this view, we propose Outcome-Verified Comparative Self-Distillation (OVCSD). OVCSD organizes failed student rollouts into a prefix tree, adaptively invokes a skill-conditioned teacher from student-reached states, and retains only outcome-verified successful continuations. It then applies localized comparative learning at the first state-aligned divergence and distills the post-divergence teacher suffix to transfer completion behavior. Experiments on ALFWorld and WebShop across three model scales show that OVCSD consistently outperforms skill-free RL and existing self-distillation baselines, achieving up to 29.7 and 5.4 absolute success-rate gains over the strongest baselines on ALFWorld and WebShop, respectively, while adding less than 3% privileged interaction during training.

cs.AI↗

Spatial Lifting for Dense Prediction

We present Spatial Lifting (SL), a novel methodology for dense prediction tasks. SL operates by lifting standard inputs, such as 2D images, into a higher-dimensional space and subsequently processing them using networks designed for that higher dimension, such as a 3D U-Net. Counterintuitively, this dimensionality lifting allows us to achieve good performance on benchmark tasks compared to conventional approaches, while reducing inference costs and \textbf{drastically lowering the number of model parameters}. The SL framework produces intrinsically structured outputs along the lifted dimension. This emergent structure facilitates dense supervision during training and enables single-forward-pass self-consistency-based quality and uncertainty estimation at test time. Spatial Lifting introduces a simple and general modeling strategy that offers a promising path toward more efficient, accurate, and reliable deep networks for dense prediction tasks in vision.

cs.CV↗

Non-equilibrium fluctuations of a two-species exclusion process with slow boundary

We study the non-equilibrium density fluctuations of a one-dimensional two-species symmetric simple exclusion process in contact with critical slow boundary reservoirs. The boundary rates are of order $1/n$, which leads to Robin boundary conditions at the macroscopic level. We prove that the coupled fluctuation field associated with the empirical densities of two species converges to a generalized Ornstein-Uhlenbeck process. The limiting process is characterized by a linear martingale problem whose coefficients reflect the combined effects of bulk diffusion, species conversion, and the boundary reservoirs.

math.PR↗

Latent Variable-Mediated Cross-Learning for Few-Shot Acoustic Impedance Imaging

Acoustic impedance imaging is a fundamental yet severely ill-posed problem in subsurface analysis: the seismic wavelet is unknown, observations are band-limited, and labeled well-log samples are extremely scarce (typically <1% of all traces). Existing semi-supervised deep learning methods mitigate few-shot problem by incorporating forward modeling, yet they either rely on inaccurate prior wavelet assumptions or introduce auxiliary networks, leading to unstable optimization and degraded performance. We propose RD-SCL, a novel framework that integrates regularized deconvolution with semi-supervised cross-learning. At its core lies a differentiable, closed-form first-order Tikhonov deconvolution operator that dynamically estimates the latent wavelet in the frequency domain during training, providing stable physics-guided feedback without explicit auxiliary networks and fixed wavelet priors. Building on this operator, we design a symmetric cross-learning that enforces consistency between predictions on labeled and unlabeled data, thereby effectively exploiting abundant unlabeled traces. Extensive experiments on the SEAM and Marmousi 2 benchmarks demonstrate that RD-SCL consistently outperforms state-of-the-art supervised and semi-supervised methods, achieving substantial gains with lower computational cost. With only 56.5k learnable parameters and competitive runtime, RD-SCL offers a practical, physically consistent, and efficient solution for acoustic impedance imaging.

cs.CV↗

Entropy-Based Characterization of Fluctuations in Stochastically Perturbed Integrable Hamiltonian Systems

We study the entropy characteristics of stochastic fluctuations arising from randomly perturbed integrable Hamiltonian systems. Starting from action-angle dynamics, we derive a discrete fluctuation process and investigate its asymptotic randomness from both dynamical and information theoretic perspectives. On the dynamical side, we establish an entropy variational principle for the induced shift dynamics on an energy-constrained infinite-dimensional path space. We show that, among all invariant probability measures satisfying the asymptotic energy constraint inherent to the system, the maximal entropy rate is attained by a Gaussian product measure. This establishes an entropy variational principle for stochastic dynamical trajectories under an asymptotic energy constraint. On the statistical side, we characterize the asymptotic Gaussian behavior of accumulated fluctuations through information-theoretic convergence. Beyond weak convergence given by the central limit theorem, we prove convergence of relative entropy and total variation distance between the fluctuation distributions and their Gaussian limits.

math.DS↗

Effective stability for Hamiltonian PDEs vanishing spectral gaps

This paper studies the effective stability of nearly integrable Hamiltonian PDEs with asymptotically vanishing spectral gaps ($0 < α< 1$). Under a unified high-low frequency decomposition, we construct a modified block clustering partition based on Bourgain's ideas. By leveraging the vanishing of spectral gaps to suppress high-frequency resonant contributions, the overall non-resonance property is maintained under high-regularity weights. This framework is applied to space fractional and fully dispersive Whitham-Schrödinger equations, uniformly yielding explicit stability estimates in Gevrey, logarithmic ultra-differentiable, and Sobolev spaces.

math.AP↗

3D Geometric Tooth Alignment Planning via Deep Reinforcement Learning

3D geometric tooth alignment planning, which determines sequential trajectories from initial malocclusion to the final target alignment, is a cornerstone of modern digital orthodontics. This paper presents a novel deep reinforcement learning (DRL) framework to automate the generation of these alignment paths. We formulate the planning process as a Markov Decision Process (MDP) to capture its sequential decision-making nature, focusing on optimizing geometric trajectories while integrating essential spatial constraints, such as inter-dental collision avoidance and path efficiency. The proposed method leverages the Deep Deterministic Policy Gradient (DDPG) algorithm, enhanced by three key innovations: (1) a Transformer-based agent to model complex spatial interactions between teeth and manage high-dimensional state-action spaces; (2) a dynamic masking scheme that restricts movement to a sparse subset of teeth per step, better reflecting the clinical logic of sequential alignment; and (3) a two-stage curriculum learning strategy that gradually increases task difficulty to ensure training stability and efficient path discovery. We evaluate our approach on a dataset of 10K expert-designed treatment plans based on clinical data. Experimental results demonstrate that our method outperforms existing baselines in terms of path safety and geometric efficiency, providing a robust and automated solution for 3D geometric orthodontic alignment planning.

cs.CV↗

AgentSociety 2: An Integrated Research Environment for Executable Social Science

AI scientist systems are beginning to automate parts of scientific research, but social science poses a distinct challenge: its objects of inquiry are not merely datasets or laboratory protocols, but integrated social processes involving situated participants, interaction contexts, interventions, and outcomes. Yet a critical link is missing: existing systems either assist isolated research tasks or simulate agents as experimental subjects, leaving the research workflow and simulated society decoupled. Here we introduce AgentSociety 2, an Integrated Research Environment for executable social science. It couples two roles of LLM agents in the same runtime: AI social scientists that coordinate literature grounding, hypothesis generation, experiment design, simulation execution, result interpretation, and manuscript drafting; and silicon participants that generate behavioral responses within configurable social environments. This dual-role design turns hypotheses into auditable agent behaviors, environment rules, interventions, and measurements, thereby supporting an end-to-end workflow. Across seven illustrative studies spanning micro-level social-science laboratory experiments, meso-level dynamics in social media, and macro-level urban scenarios, we demonstrate its capacity to support diverse disciplinary questions, reproduce major qualitative patterns from prior studies, identify informative deviations, and enable large-scale simulations through optimized agent-environment interactions. By preserving human researchers' high-level agency while delegating procedural orchestration to agentic systems, it provides a human-in-the-loop and controllable infrastructure for next-generation computational social science, with broader applications in scalable computational social experimentation and AI-enabled social governance platforms.

cs.CY↗

Unidirectional Transverse Scattering in Acoustic Dimers

We study unidirectional transverse scattering in a two-dimensional acoustic dimer composed of two circular subwavelength scatterers. Using a coupled multipole model, we show that interparticle coupling enables effective monopole--dipole interference and supports a transverse Kerker effect under plane-wave excitation. In contrast to a single non-absorbing rotationally symmetric particle, where Kerker-type directional scattering is only approached in the weak-scattering limit, the dimer can combine pronounced directionality with strong overall scattering. This regime is promising for compact acoustic beam steering and directional wave routing.

physics.class-ph↗

Onsager--Machlup Functionals for Generalized Newtonian Equations of Motion with Time-Varying Fractional Noise

In this paper, we derive the Onsager--Machlup functional for a class of degenerate stochastic differential equations on $\mathbb{R}^{m+n}$ driven by $n$-dimensional fractional Brownian motion with time-dependent diffusion coefficients, where the Hurst parameter satisfies $H\in(1/4,1)$. The main difficulty arises from the interaction between the degenerate structure and the multidimensional fractional noise, which produces nontrivial coupling terms under small-ball conditioning. By combining the Gaussian correlation inequality with an approximation argument for infinite-dimensional convex sets, we establish a decoupling mechanism that allows these coupling effects to be controlled by unconditional Gaussian expectations. Furthermore, through regularity estimates for the degenerate components and sharp Hölder norm estimates, we eliminate the remaining coupling contributions and obtain an explicit expression for the Onsager--Machlup functional. As applications of the derived functional, we obtain the corresponding constrained Euler--Lagrange equations characterizing the most probable transition paths of the system, and establish a sufficient condition under which the stochastic differential equation preserves the most probable path.

math.PR↗

Worldscape-MoE: A Unified Mixture-of-Experts World Model for Scalable Heterogeneous Action Control

World models are rapidly becoming a core infrastructure for embodied intelligence and interactive agents: they provide controllable simulators in which agents can perceive, act, forecast, and acquire scalable experience. Yet current video generation world models are still organized around isolated control interfaces, such as camera trajectories, robot actions, or hand-joint signals. This fragmentation is increasingly a scaling bottleneck. The central challenge is not the absence of controllable generators, but the lack of a unified and extensible learning framework that can absorb heterogeneous action supervision while preserving a shared model of world dynamics. In this work, we introduce Worldscape-MoE, a Mixture-of-Experts world model built on Diffusion Transformers for scalable heterogeneous action control. Our key observation is that different controls specify different interfaces to the same underlying world: although their representations differ, they constrain shared physical regularities, scene dynamics, and interaction semantics. Worldscape-MoE operationalizes this observation through modality-aware control injection, shared and control-specific experts, and a progressive MoE tuning strategy that supports continual extension to new action modalities. Experiments across locomotion, robotic manipulation, and egocentric hand control show that heterogeneous supervision improves rather than interferes with individual control capabilities. Worldscape-MoE achieves strong results on WorldArena, improves locomotion and hand-control metrics, exhibits robust out-of-distribution generalization, and demonstrates scaling behavior as additional control data and experts are integrated.

cs.RO↗

Linking effective Ratner equidistribution to the semicircle law for skew-shift matrices

We consider large Hermitian matrices whose entries are defined by evaluating the exponential function along orbits of the skew-shift \(\frac{j(j-1)}{2}ω+ jy + x \mod 1\) for irrational \(ω\). We establish a rigorous connection between the effective Ratner equidistribution theorem for unipotent orbits in \(\SL(3,\R)/\SL(3,\Z)\) and the global semicircle law for such deterministic matrices. For frequency sequences satisfying a Diophantine condition, we prove that the empirical spectral distribution of these matrices converges to the Wigner semicircle law with optimal polynomial rate \(O(N^{-1})\); for rectangular matrices the corresponding Marchenko--Pastur law is obtained. The proof uses a multi-parameter effective mixing property derived from the effective Ratner equidistribution theorem, combined with a graph-theoretic expansion of the moments. Our results evidence the quasirandom nature of the skew-shift dynamics observed in other contexts by Bourgain, Goldstein and Schlag, and Rudnick, Sarnak and Zaharescu, and provide a dynamical systems proof of the semicircle law with an improved convergence rate.

math.DS↗