Search arXiv⌕ Search

arXiv subjects

Yang Liu

Publications and source records attributed to Yang Liu.

At least 145 records · Page 8Linked to original sources

When Words Fall Short: Iterative Synergy Between Verbalized Reasoning and Hidden Features for LLM Confidence Estimation

Confidence estimation is crucial for developing trustworthy large language models (LLMs), with most methods following estimator-based or verbalization-based paradigms. While recent research increasingly focuses on improving verbalized self-reports of confidence, we challenge the prevailing view that this approach surpasses independent confidence estimators. Our empirical study shows that a dedicated confidence estimator can substantially outperform verbalized confidence, indicating that LLMs' internal representations contain richer confidence signals. Building on this finding, we propose Iterative Policy-Estimator Training (IPoET), a framework that synergizes the complementary strengths of verbalized reasoning traces and informative representations. IPoET alternates policy optimization with estimator updating, integrating estimator-derived confidence feedback into policy learning and refreshing the estimator on new policy rollouts. Experiments across diverse datasets and Qwen and Llama backbones demonstrate that, by iteratively exploiting richer hidden features and adapting to the evolving policy distribution, IPoET consistently outperforms both estimator- and verbalization-based baselines in-domain and achieves superior or comparable results across all out-of-domain metrics. For more details, refer to https://github.com/xyk829/ipoet.

cs.CL↗

Beyond Verbalized Confidence: Calibrating Reasoners with Differentiable Readouts

Reinforcement learning with verifiable rewards (RLVR) trains reasoning models to produce correct answers, but does not ensure that their stated confidence is calibrated. The resulting models are systematically overconfident. Recent methods train calibration inside the RLVR loop by having the model state a numerical confidence alongside its answer, but they all obtain the confidence by sampling it as text. This choice imposes two costs: a sampled confidence introduces variance and in practice collapses to a handful of distinct values, and sampling makes the confidence non-differentiable, forcing the calibration loss through a scalar reward. We propose CREDO (Confidence REaDOut) to replace sampling with a deterministic readout. While RLVR optimizes correctness, CREDO reads the confidence from a dedicated token pair in the model's output distribution and trains it by differentiable regression. CREDO further turns the trained confidence into a signal for accuracy, weighting rollouts by how far confidence and outcome disagree, so that accuracy and calibration improve together. Across mathematical and code reasoning, CREDO attains the best accuracy and calibration, and the gains extend to abstention and selective prediction.

cs.LG↗

VD-DeepStack: Bridging Visual Comparison and Language Reasoning for Few-Shot Anomaly Detection

Few-shot visual anomaly detection is fundamentally a visual comparison task, requiring fine-grained inspection of a query against normal references. Many recent methods based on large vision-language models (LVLMs) emphasize comparative reasoning through language chain-of-thought. Yet discrete, abstract descriptions may underrepresent dense, fine-grained visual differences, leaving a gap between visual comparison and its expression in language. To address this gap, we propose Visual Difference DeepStack (VD-DeepStack), which explicitly conditions language reasoning on query-reference visual differences. Specifically, we fuse DINO features with the LVLM visual hierarchy to strengthen fine-grained representations, then construct dense difference evidence from residuals between query features and softly matched reference features. The difference-evidence path injects spatially weighted difference vectors into query-image states at multiple decoder depths, while an auxiliary visual-context path provides fine-grained appearance information to support their interpretation. Experiments on 4 industrial and 2 medical anomaly benchmarks demonstrate substantial improvements in few-shot anomaly detection over baselines relying on textual comparative reasoning. These results support mitigating the visual comparison-reasoning gap through the joint design of comparison representations and their integration into the decoder. Code will be released upon acceptance.

cs.AI↗

SmartMemory: Detecting On-chain-off-chain Communication Inconsistency for Smart Contract via Memory-based Agent

Smart contracts underpin decentralized finance, where growing demand for on-chain/off-chain communication(OFC) has driven diverse applications such as cross-chain bridges, real-world asset tokenization, and fiat-backed stablecoins. TheOFC-related security incidents in these applications are increasingly frequent, but prior studies address separate vulnerability categories within OFC applications rather than providing a unified view, causing vulnerabilities outside known patterns to be missed.In this paper, we identify OFC inconsistency (OFCI) as a root cause of OFC vulnerabilities, which arises from business-logic flaw and ultimately breaks the equivalence between the on-chain and off-chain asset representations to induce inconsistency.Automatically detecting OFCIs faces two challenges including (1)locating heterogeneous business logic, and (2) transferring existing vulnerability knowledge to identify unseen OFCI instances. To this end, we propose SmartMemory, the first framework to leverage a memory-based agent for OFCI detection. To address heterogeneity, SmartMemory maps diverse implementations ofOFC contracts into a canonical business-semantic representation to locate the business logic for OFCI inspection. For knowledge reuse, SmartMemory integrates a memory-based agent to distill vulnerability knowledge from features into patterns and detection rules, enabling knowledge transfer across cases to identify unseenOFCIs. Lastly, SmartMemory performs taint analysis to verify the reachability, type, and impact of each candidate OFCI. We construct the first real-world OFCI dataset comprising 48 DApps with 81 OFCIs for evaluation, on which SmartMemory achieves80.68% precision and 87.65% recall. In addition, through an analysis of 325 real-world OFC applications, SmartMemory detects 36 previously unknown OFCIs, all of which have been confirmed and fixed by corresponding parties.

cs.SE↗

Gel-Confined Rolling-Circle Amplification Enables Sensitive Single-Cell Proteoform Analysis

Protein abundance alone does not capture the molecular diversity generated by protein processing and post-translational modification, yet most single-cell protein assays do not resolve these proteoform states. Here, we develop RCAmp-scWB, a post-separation amplification strategy that performs rolling-circle amplification directly within the polyacrylamide gel after single-cell protein electrophoresis. Reaction-transport modeling identifies a balance between reagent access and confinement of the template-associated amplification product that supports signal amplification while retaining the electrophoretically encoded spatial readout. Using purified protein standards, RCAmp-scWB produced a 4.0-7.8-fold steeper concentration-response slope than conventional single-cell western blotting. Across six human cancer cell lines, RCAmp-scWB quantified protein abundance and resolved distinct Vimentin and PD-L1 proteoform states whose relative abundance and single-cell distributions were not captured by total protein measurements alone. Extension to individual small extracellular vesicles further revealed source-dependent shifts in Vimentin proteoform composition despite comparatively similar abundance of one major Vimentin species. By separating electrophoretic molecular discrimination from signal amplification, RCAmp-scWB enables proteoform-resolved analysis of heterogeneous cells and small extracellular vesicles.

q-bio.QM↗

Next Thoughts Are Distributions: Generative Autoregressive Reasoning in the Latent Space

Reasoning problems often admit multiple valid ways to proceed. Continuous reasoning promises to move computation beyond language tokens into a more compact latent space, but representing several plausible ways to think next remains difficult. We introduce Autoregressive Thought Flow (ATF), which models the next continuous thought as a multimodal distribution. A causal autoregressive model performs the reasoning computation, while a lightweight diffusion head generates a plausible next thought from the resulting condition. The sampled thought is fed back into the model, allowing continuous reasoning to unfold for a variable number of steps while preserving the pretrained backbone. Across mathematical reasoning tasks, ATF improves accuracy with compact latent traces and benefits from reinforcement learning and additional test-time thinking. Multi-sample evaluation shows broader solution coverage, indicating that its multimodal predictions capture useful diversity among reasoning paths. Our results suggest that continuous reasoning is more effective when multiple possible next thoughts remain available rather than being collapsed into a single prediction.

cs.AI↗

PhysAlign: A Benchmark for Evidence-Grounded Role Alignment in Multimodal Physics Reasoning

A key challenge in physics diagram understanding is correctly associating visual information with the physical entities, relations, and conditions it describes. Even when a value, symbol, or other local element is accurately recognized, assigning it to the wrong entity or scope can distort the underlying physical premise and lead to incorrect reasoning. To systematically study this challenge, we introduce \textbf{PhysAlign}, a benchmark designed to assess whether multimodal models correctly associate information recognized from physics diagrams with its intended physical role. By disentangling visual recognition from physical-role assignment through localized probes and controlled variants, PhysAlign isolates correspondence errors from recognition failures. It contains 3,341 human-validated probes spanning 986 physics problems, enabling systematic evaluation of visual recognition and physical-role correspondence at scale. We further introduce five complementary evaluation metrics, including CAcc, GAcc, and JAcc, which provide a comprehensive assessment of models' ability to recognize diagram content, establish correct physical correspondences, and solve the underlying physics problem. Across our evaluated multimodal models, PhysAlign reveals a consistent gap between local visual recognition and physical-role grounding. Even when the queried content is correctly recognized, the conditional correspondence error rate remains 13.8\% for GPT-6-Astra and rises to about 50.6\% for InternVL3.5-8B. These findings indicate that strong perception alone does not ensure reliable physical interpretation, exposing a distinct grounding bottleneck that is largely hidden by answer-level accuracy and highlighting the need for future models to better align recognized visual evidence with its physical meaning.

cs.AI↗

Predicting Block-Coordinate Performance via Cross-Curvature

Simultaneous and sequential block updates are two basic optimization strategies used across machine learning, such as neural-network training, federated learning, and low-rank adaptation. Choosing between them is difficult because their relative advantage depends on both the objective geometry and the number of iterations. We develop a unified theory for comparing Jacobi (JC), Gauss--Seidel (GS), and partially sequential deterministic block-gradient updates. Our analysis expresses the one-step loss difference through cross-block curvature, with an $O(η^3)$ remainder, where $η$ is the learning rate. We derive a signed loss comparison after $K$ iterations with $O(Kη^3)$ error under regularity conditions and $ηK\le T$ for fixed $T$, identifying the better method when the predicted difference exceeds this error. We evaluate these formulas along observed training trajectories across different machine learning settings. Over 500 iterations, our theory correctly identifies the lower-loss method in 98.0\% of iterations for the neural network, 83.4\% for federated learning, and 97.6\% for LoRA. Applying the loss recursion at each step using the measured parameter difference raises these rates to 100.0\%, 93.2\%, and 99.6\%, respectively.

cs.LG↗

Lattice Structure Optimization for Additive Manufacturing: Manufacturability-Driven Design and Pareto Front Construction

Lattice metamaterials support lightweight, multifunctional structures, while additive manufacturing (AM) enables complex geometries. Yet multiphysics lattice design faces two challenges: efficiently constructing well-covered multi-objective Pareto fronts under limited budgets, and satisfying manufacturing constraints such as overhangs, enclosed cavities, and restricted powder-removal channels. We propose a manufacturing-constraint-driven method for lattice optimization and Pareto-front construction. Differentiable manufacturing constraints are embedded in inverse-homogenization topology optimization, enabling joint optimization of physical performance and manufacturability. A progressive Pareto-front mechanism uses a density-generation network to learn latent representations of high-quality lattices, interpolates neighboring nondominated representations, and decodes them into initial density fields for subsequent optimization. Newly found nondominated solutions update the network and sample set, progressively expanding the manufacturable set. On 3D periodic unit cells, with 1000 optimization runs, network initialization achieves a 92.60% success rate and 916 manufacturable samples, versus 78.30% and 776 for random initialization. Its Pareto front reaches a hypervolume of 0.0787, compared with 0.0675 for random initialization. The results show that the method efficiently constructs broadly covered manufacturable Pareto fronts for multiple physical properties.

cs.GR↗

High-fidelity geometric quantum gates exceeding 99.9% in germanium quantum dots

Achieving high-fidelity and robust qubit manipulations is a crucial requirement for realizing faulttolerant quantum computation. Here, we demonstrate a single-hole spin qubit in a germanium quantum dot and characterize its control fidelity using gate set tomography. The maximum control fidelities reach 97.48%, 99.81%, 99.88% for the I, X/2 and Y /2 gate, respectively. These results reveal that off-resonance noise during consecutive I gates in gate set tomography sequences severely limits qubit performance. Therefore, we introduce geometric quantum computation to realize noiseresilient qubit manipulation. The geometric gate control fidelities remain above 99% across a wide range of Rabi frequencies. The maximum fidelity surpasses 99.9%. Furthermore, the fidelities of geometric X/2 and Y /2 (I) gates exceed 99% even when detuning the microwave frequency by +-2.5 MHz (+-1.2 MHz), highlighting the noise-resilient feature. These results demonstrate that geometric quantum computation is a potential method for achieving high-fidelity qubit manipulation reproducibly in semiconductor quantum computation.

quant-ph↗

Descent-Guided Policy Gradient for Scalable Cooperative Multi-Agent Learning

Scaling cooperative multi-agent reinforcement learning (MARL) is fundamentally limited by cross-agent noise. When agents share a common reward, each agent's learning signal is computed from a shared return that depends on all agents, so the stochasticity of the other agents enters the signal as cross-agent noise that grows with $N$. Many engineering systems, such as cloud computing and power systems, have differentiable analytical models that prescribe efficient system states, providing a new reference beyond noisy shared returns. In this work, we propose Descent-Guided Policy Gradient (DG-PG), a framework that augments policy-gradient updates with a low-noise descent signal toward this reference. We prove that DG-PG reduces policy-gradient estimator variance from $\mathcal{O}(N)$ to $\mathcal{O}(1)$, preserves the stationary points of the cooperative objective, and achieves agent-independent sample complexity $\mathcal{O}(1/ε^3)$. We evaluate DG-PG on cloud resource scheduling and power dispatch tasks, which involve discrete and continuous decisions, respectively. In both tasks, DG-PG converges within 10 episodes on average at every scale up to 1500 heterogeneous agents.

cs.MA↗

World Agent: Can Language Models Keep a World Running?

World models are moving from generating realistic frames to generating playable worlds, yet whether a delivered world can keep running is not tested anywhere. Existing evaluations stop at generation, at delivery, or at single-step transitions, and each stops at a different point along the way. Correct local state transitions or intermediate outcomes do not guarantee a correctly organized causal event flow. We propose the world agent task, which moves the evaluation point of world generation from the moment of delivery to the continued operation that follows. In this task, a model is not asked to generate a world. It is held responsible for keeping the world running, which requires coordinating events and carrying forward their consequences to constrain subsequent evolution. We instantiate the task in WorldAgent-Benchmark with two complementary tracks. In the maintenance track, the model must ground the events of a continuous narrative into correct transitions of the explicit world state while respecting causal, temporal, and concurrency constraints. In the deduction track, the model must predict how the world will evolve under partial observations and act toward a goal. The maintenance track combines LLM-assisted semantic judgments with programmatic validation and scoring, while the deduction track is evaluated entirely programmatically. Individual judgments are auditable against world states and execution logs, and scores can be recomputed from the saved judgments and execution records. Across 8 models, scores decline steadily as pre-built structure is removed from the world, and causal-relation checking is the weakest component for every model. The benchmark makes the continued operation of a world measurable and distinguishes local completion from failures in event organization. Code and dataset will be released on https://github.com/HCPLab-SYSU/WorldAgent-Benchmark.

cs.AI↗

When Forgetting Looks Like Improvement: Metric Masking in Streaming Diarizer Adaptation and the Price of Rehearsal

Small-data adaptation can improve speech detection while degrading speaker attribution. We study this discrepancy in a released streaming diarizer adapted on 7.5 h of two-party conversation and evaluated across six corpora. Adaptation substantially improves in-domain diarization performance and transfers to an independent corpus. However, this improvement is not consistent across evaluation scenarios as the additional confusion is mainly associated with impaired temporal identity consistency rather than speaker-count errors. A local-remapping diagnostic reveals different patterns of identity degradation across corpora, indicating that adaptation may alter how streaming models maintain speaker assignments over time. Rehearsal reduces the observed degradation but reduces the cross-domain transfer performance. These results highlight the need to jointly evaluate detection accuracy, identity consistency, and retention behavior when adapting streaming diarization systems.

cs.CL↗

CODESKILL: Learning Self-Evolving Skills for Coding Agents

Coding agents produce rich trajectories while solving software-engineering tasks. To enable agent self-evolution, these trajectories can be distilled into reusable procedural skills that compactly encode experience to guide future behavior. However, existing skill construction and maintenance methods often rely on fixed prompts and heuristic update rules, leaving it unclear how knowledge should be selected, abstracted, and maintained to best serve downstream agents. We propose CODESKILL, an LLM-based framework that reformulates skill extraction and skill-bank maintenance as a learnable management policy. CODESKILL extracts multi-granularity procedural skills from coding-agent trajectories, evolves skills with new experience, and maintains a compact skill bank for future task solving. We train CODESKILL with reinforcement learning, using a hybrid reward that combines dense rubric-based skill-quality feedback with sparse verifiable execution feedback from the frozen downstream agent. Experiments on EnvBench, SWE-Bench Verified, and Terminal-Bench 2 show that CODESKILL improves average pass rate by 11.03 over the no-skill baseline and by 5.10 over the strongest prompt-based or memory baseline, while maintaining a compact skill bank.

cs.AI↗

Context-Aware Functional Modeling for Android Third-Party Library Detection

Third-party libraries (TPLs) are widely used in Android apps, but their reuse can introduce security risks and interfere with downstream program analyses. Existing Android TPL detection approaches face two key limitations: their hand-crafted features are fragile under aggressive code transformations, and their whole-library matching strategies are ineffective when apps retain only part of a TPL. In this paper, we propose LibFan, a learning-based Android TPL detection approach based on context-aware functional modeling. It realizes this modeling through two complementary components: context-aware contrastive learning at the method level and functional partitioning at the library level. At the method level, it learns semantic representations through contrastive training while incorporating outgoing call relationships and class-level context, improving robustness to obfuscation, shrinking, and optimization. At the library level, it partitions each TPL into functionally coherent units and determines library presence using the best-matching partition, thereby accommodating partial library reuse. To evaluate LibFan, we construct a new benchmark comprising 200 apps and 46 vulnerable TPLs, with each app compiled under four transformation configurations. Under the most challenging R8 full mode, LibFan achieves F1 scores of 81.3% at the library level and 47.6% at the version level, representing relative improvements of 64.9% and 35.6% over the state of the art, respectively.

cs.CR↗

Dispersion Measure Distribution of Unlocalized Fast Radio Bursts as a Probe of the Hubble Constant

We present constraints on the Hubble constant ($H_0$) derived from the observed dispersion measure (DM) distribution of unlocalized fast radio bursts (FRBs). While localized FRBs with redshift measurements have been used to investigate the Hubble tension, their sample remains limited. Here we demonstrate that unlocalized FRBs---which are far more numerous---can independently constrain $H_0$ without requiring redshift information, as cosmic expansion imprints itself on their DM distribution. Analyzing a selected sample of 2124 unlocalized FRBs from the CHIME Catalog II, we obtain $H_0 = 69^{+17}_{-15}~\mathrm{km\,s^{-1}\,Mpc^{-1}}$ at the $1σ$ confidence level, corresponding to an uncertainty of about 22\%. Disentangling the parametric degeneracy among $H_0$, the FRB spectral index $α$, and the characteristic cutoff energy $E_*$ of the FRB energy distribution would reduce the fractional uncertainty in $H_0$ to 9\%. This work constitutes the first $H_0$ measurement derived solely from the DM distribution of unlocalized FRBs, highlighting their potential as a new cosmological probe. Future joint analyses with localized FRBs promise even tighter constraints.

astro-ph.CO↗

Generative crystallographic phasing through invariant relationships

Crystal structure determination requires the phases of scattered waves -- yet diffraction measures only their intensities. Direct methods exploit phase invariants but become less reliable as diffraction information diminishes. Learned phase prediction has lowered the resolution barrier, yet remains primarily confined to centrosymmetric crystals with binary phases. We introduce PhiGen, a generative reformulation of traditional direct methods that learns origin-independent phase relationships for binary and continuous phasing. Across 210 space groups, including groups absent from training, it recovered high-quality maps for 99.0% of centrosymmetric structures and invariant-consistent phases for 92.8% of non-centrosymmetric structures. From simulated 3 Å zeolite powder data, the network recovered framework maps for 84.2% of held-out structures, versus 1.0% for Superflip. For experimental ZSM-25 and TNU-9, generated phases seeded high-resolution phase extension. These results suggest a route to structure determination from low-resolution, incomplete, and overlapped diffraction data.

cond-mat.mtrl-sci↗

UCON: Uncertainty-aware Navigation with Historical Re-association in Dynamic Environments

Autonomous navigation in dynamic environments is hindered by two fundamental challenges: perception instability and uncertainty-optimization mismatch. The former leads to identity switches and unreliable motion estimation, while the latter prevents principled incorporation of motion uncertainty into trajectory optimization. To address these challenges, we propose UCON, an uncertainty-aware navigation algorithm in dynamic environments. For perception instability, we present a point-level historical re-association mechanism that leverages historical point cloud fragments to recover lost targets while maintaining identity continuity. Subsequently, a Kalman filter is employed to provide anisotropic motion state estimation and covariance propagation. To resolve the uncertainty-optimization mismatch, we transform predicted states and their covariances into uncertainty sectors, which are embedded as differentiable cost terms within a trajectory optimization framework. This achieves consistent uncertainty-aware dynamic obstacle avoidance while maintaining smoothness and feasibility. Extensive simulations and real-world experiments demonstrate that, while maintaining high computational efficiency, UCON achieves superior perception stability and robust navigation performance in dynamic environments compared to state-of-the-art methods. The code will be open-sourced to facilitate further research.

cs.RO↗