Search arXiv⌕ Search

arXiv subjects

Yang Chen

Publications and source records attributed to Yang Chen.

At least 199 records · Page 11Linked to original sources

Clustering-Based Weight Orthogonalization for Stabilizing Deep Reinforcement Learning

Reinforcement learning (RL) has made significant advancements, achieving superhuman performance in various tasks. However, RL agents often operate under the assumption of environmental stationarity, which poses a great challenge to learning efficiency since many environments are inherently non-stationary. This non-stationarity results in the requirement of millions of iterations, leading to low sample efficiency. To address this issue, we introduce the Clustering Orthogonal Weight Modified (COWM) layer, which can be integrated into the policy network of any RL algorithm and mitigate non-stationarity effectively. The COWM layer stabilizes the learning process by employing clustering techniques and a projection matrix. Our approach not only improves learning speed but also reduces gradient interference, thereby enhancing the overall learning efficiency. Empirically, the COWM outperforms state-of-the-art methods and achieves improvements of 9% and 12.6% in vision based and state-based DMControl benchmark. It also shows robustness and generality across various algorithms and tasks.

cs.LG↗

Diamond quantum sensing at record high pressure up to 240 GPa

Quantum sensing utilizing nitrogen-vacancy (NV) centers in diamond has emerged as a transformative technology for probing magnetic phase transition1-4, evidencing Meissner effect of superconductors1,5-9, and visualizing stress distribution3,9 under extreme conditions. Recent development in NV configurations and hydrostatic environments have raised the operational pressures of NV centers to 140 GPa2,6,10,11, but substantial challenges remain in extending sensing capabilities into multi-megabar range, critical for research in hydrogen-rich superconductors like La-Sc-H ($T_{\text{c}}$ of 271-298 K at 195-266 GPa)12 and evolution of minerals near Earth's core13. Here we report the fabrication of shallow NV centers through ion implantation followed by high-pressure and high-temperature (HPHT) annealing, leading to increased density, improved coherence, and mitigated internal stresses, a pre-requisite for reducing their degradation under compression. This NV magnetometry enable breakthrough of pressure capabilities exceeding 240 GPa, constrained by structural integrity of the 50 um diamond anvils, suggesting that the untapped pressure limit may enable further advancements with smaller cutlets or more robust diamonds. We present compelling evidence of the Meissner effect and trapped flux at record-high pressure of 180 GPa for superconducting transition in elemental titanium (Ti) as benchmark, establishing a solid foundation for high-pressure magnetometry in exploring complex quantum phenomena at previously unreachable pressures.

quant-ph↗

Dexbotic: Open-Source Vision-Language-Action Toolbox

In this paper, we present Dexbotic, an open-source Vision-Language-Action (VLA) model toolbox based on PyTorch. It aims to provide a one-stop VLA research service for professionals in the field of embodied intelligence. It offers a codebase that supports multiple mainstream VLA policies simultaneously, allowing users to reproduce various VLA methods with just a single environment setup. The toolbox is experiment-centric, where the users can quickly develop new VLA experiments by simply modifying the Exp script. Moreover, we provide much stronger pretrained models to achieve great performance improvements for state-of-the-art VLA policies. Dexbotic will continuously update to include more of the latest pre-trained foundation models and cutting-edge VLA models in the industry.

cs.RO↗

A Giant Peanut-shaped Ultra-High-Energy Gamma-Ray Emitter Off the Galactic Plane

Ultra-high-energy (UHE), exceeding 100 TeV (10^12 electronvolts), γ-rays manifests extreme particle acceleration in astrophysical sources. Recent observations by γ-ray telescopes, particularly by the Large High Altitude Air Shower Observatory (LHAASO), have revealed a few tens of UHE sources, indicating numerous Galactic sources capable of accelerating particles to PeV (10^15 electronvolts) energies. However, discerning the dominant acceleration mechanisms (leptonic versus hadronic), the relative contributions of specific source classes, and the role of particle transport in shaping their observed emission are central goals of modern UHE astrophysics. Here we report the discovery of a giant UHE γ-ray emitter at -17.5° off the Galactic plane - a region where UHE γ-ray sources are rarely found. The emitter exhibits a distinctive asymmetric shape, resembling a giant "Peanut" spanning 0.45° \times 4.6°, indicative of anisotropic particle distribution over a large area. A highly aged millisecond pulsar (MSP) J0218+4232 is the sole candidate accelerator positionally coincident with the Peanut region. Its association with UHE γ-rays extending to 0.7 PeV, if confirmed, would provide the first evidence of a millisecond pulsar powering PeV particles. Such a finding challenges prevailing models, which posit that millisecond pulsars cannot sustain acceleration to PeV energies. The detection reveals fundamental gaps in understanding particle acceleration, cosmic-ray transport, and interstellar magnetic field effects, potentially revealing new PeV accelerator (PeVatron) classes.

astro-ph.HE↗

Imaging magnetic flux trapping in lanthanum hydride using diamond quantum sensors

Lanthanum hydride has attracted significant attention in recent years due to its signatures of superconductivity at around 250 K (1, 2). However, the megabar pressures required for synthesize and maintain its state present extraordinary challenges for experiments, particularly in characterizing its Meissner effect (3, 4). The nitrogen-vacancy (NV) center in diamond has emerged as a promising quantum probe to address this problem (5-8), but a gap remains between its working pressure and the pressure required to study the superconducting state of lanthanum hydride (9-12). In this work, using neon gas as the pressure transmitting medium, the working pressure of NV centers is extended to nearly 200 GPa. This quantum probe is then applied to study the Meissner effect of a LaH$_{9.6}$ sample, synthesized by laser heating ammonia borane and lanthanum. A strong magnetic shielding effect is observed, with the transition temperature beginning at around 180 K and completing at 220 K. In addition, magnetic field imaging after field cooling reveals strong flux trapping and significant inhomogeneities within the sample. Our work provides compelling evidence for superconductivity in lanthanum hydride and highlights the importance of spatially resolved techniques in characterizing samples under ultrahigh pressure conditions.

cond-mat.supr-con↗

RoboChallenge: Large-scale Real-robot Evaluation of Embodied Policies

Testing on real machines is indispensable for robotic control algorithms. In the context of learning-based algorithms, especially VLA models, demand for large-scale evaluation, i.e. testing a large number of models on a large number of tasks, is becoming increasingly urgent. However, doing this right is highly non-trivial, especially when scalability and reproducibility is taken into account. In this report, we describe our methodology for constructing RoboChallenge, an online evaluation system to test robotic control algorithms, and our survey of recent state-of-the-art VLA models using our initial benchmark Table30.

cs.RO↗

Skin mode tunability and self-healing effect in photonic Floquet lattices

Non-Hermitian systems host exotic phenomena absent in their Hermitian counterparts, including the recently predicted self-healing effect (SHE) of non-Hermitian skin modes. To date, the SHE of skin modes in non-Hermitian systems has not been observed experimentally. Here we propose a feasible scheme to realize SHE in photonic Floquet lattices by exploiting skin mode tunability (SMT), a mechanism in which the spectrum of skin modes localized at one boundary can be tuned via a potential applied at the opposite boundary. Such tunability arises from the non-Hermitian biorthogonality of the eigenstates. We demonstrate that a certain skin mode is exceptionally sensitive to remote-boundary potentials in an array of $100$ coupled helical waveguides, allowing broad-range spectral control and the generation of SHE with experimentally accessible parameters. Our results establish a general framework for engineering skin modes via local perturbations, thereby expanding the toolbox for non-Hermitian wave control.

physics.optics↗

Trust Region Reward Optimization and Proximal Inverse Reward Optimization Algorithm

Inverse Reinforcement Learning (IRL) learns a reward function to explain expert demonstrations. Modern IRL methods often use the adversarial (minimax) formulation that alternates between reward and policy optimization, which often lead to unstable training. Recent non-adversarial IRL approaches improve stability by jointly learning reward and policy via energy-based formulations but lack formal guarantees. This work bridges this gap. We first present a unified view showing canonical non-adversarial methods explicitly or implicitly maximize the likelihood of expert behavior, which is equivalent to minimizing the expected return gap. This insight leads to our main contribution: Trust Region Reward Optimization (TRRO), a framework that guarantees monotonic improvement in this likelihood via a Minorization-Maximization process. We instantiate TRRO into Proximal Inverse Reward Optimization (PIRO), a practical and stable IRL algorithm. Theoretically, TRRO provides the IRL counterpart to the stability guarantees of Trust Region Policy Optimization (TRPO) in forward RL. Empirically, PIRO matches or surpasses state-of-the-art baselines in reward recovery, policy imitation with high sample efficiency on MuJoCo and Gym-Robotics benchmarks and a real-world animal behavior modeling task.

cs.LG↗

Low-Dimension-to-High-Dimension Generalization And Its Implications for Length Generalization

Low-Dimension-to-High-Dimension (LDHD) generalization is a special case of Out-of-Distribution (OOD) generalization, where the training data are restricted to a low-dimensional subspace of the high-dimensional testing space. Assuming that each instance is generated from a latent variable and the dimension of the latent variable reflects the problem scale, the inherent scaling challenge in length generalization can be captured by the LDHD generalization in the latent space. We theoretically demonstrate that LDHD generalization is generally unattainable without exploiting prior knowledge to provide appropriate inductive bias. Specifically, we explore LDHD generalization in Boolean functions. We verify that different architectures trained with (S)GD converge to \emph{min-degree interpolators w.r.t. different independent sets}. LDHD generalization is achievable if and only if the target function coincides with this inductive bias. Applying the insights from LDHD generalization to length generalization, we explain the effectiveness of CoT as changing the structure latent space to enable better LDHD generalization. We also propose a principle for position embedding design to handle both the inherent LDHD generalization and the nuisances such as the data format. Following the principle, we propose a novel position embedding called RPE-Square that remedies the RPE for dealing with the data format nuisance.

cs.LG↗

On the Limitations and Capabilities of Position Embeddings for Length Generalization

In Transformers, Position Embeddings (PEs) significantly influence Length Generalization (LG) performance, yet their fundamental role remains unclear. In this work, we investigate the limitations and capabilities of PEs in achieving LG. We theoretically analyze PEs in Position-Only Linear Attentions (POLAs), introducing Linear Representation Complexity (LRC) to characterize when PEs enable LG. Our analysis shows that PEs do not expand computational capabilities but structure learned computations across positions. Extending to practical Transformers, we propose Sequential Representation Complexity (SRC) and conjecture that LG is possible if and only if SRC remains invariant across scales. We support this hypothesis with empirical evidence in various reasoning tasks. To enhance LG, we introduce Scale Hint, allowing flexible instance scaling, and a Learning-Based Position Embedding framework that automatically learns positional relations. Our work provides theoretical insights and practical strategies for improving LG in Transformers.

cs.LG↗

The Path of Self-Evolving Large Language Models: Achieving Data-Efficient Learning via Intrinsic Feedback

Reinforcement learning (RL) has demonstrated potential in enhancing the reasoning capabilities of large language models (LLMs), but such training typically demands substantial efforts in creating and annotating data. In this work, we explore improving LLMs through RL with minimal data. Our approach alternates between the LLM proposing a task and then attempting to solve it. To minimize data dependency, we introduce two novel mechanisms grounded in self-awareness: (1) self-aware difficulty prediction, where the model learns to assess task difficulty relative to its own abilities and prioritize challenging yet solvable tasks, and (2) self-aware limit breaking, where the model recognizes when a task is beyond its capability boundary and proactively requests external data to break through that limit. Extensive experiments on nine benchmarks showing a 53.8% relative improvement with less than 1.2% extra data demonstrate the efficacy of self-aware RL and underscore the promise of self-evolving agent training.

cs.CL↗

Making high-order asymptotics practical: correcting goodness-of-fit test for astronomical count data

The C statistic is a widely used likelihood-ratio statistic for model fitting and goodness-of-fit assessments with Poisson data in high-energy physics and astrophysics. Although it enjoys convenient asymptotic properties, the statistic is routinely applied in cases where its nominal null distribution relies on unwarranted assumptions. Because researchers do not typically carry out robustness checks, their scientific findings are left vulnerable to misleading significance calculations. With an emphasis on low-count scenarios, we present a comprehensive study of the theoretical properties of C statistics and related goodness-of-fit algorithms. We focus on common ``plug-in'' algorithms where moments of C are obtained by assuming the true parameter equals its estimate. To correct such methods, we provide a suite of new principled user-friendly algorithms and well-calibrated p-values that are ready for immediate deployment in the (astro)physics data-analysis pipeline. Using both theoretical and numerical results, we show (a) standard $χ^2$-based goodness-of-fit assessments are invalid in low-count settings, (b) naive methods (e.g., vanilla bootstrap) result in biased null distributions, and (c) the corrected Z-test based on conditioning and high-order asymptotics gives the best precision with low computational cost. We illustrate our methods via a suite of simulations and applied astrophysical analyses. An open-source Python package is provided in a GitHub repository.

stat.ME↗

Alternating Training-based Label Smoothing Enhances Prompt Generalization

Recent advances in pre-trained vision-language models have demonstrated remarkable zero-shot generalization capabilities. To further enhance these models' adaptability to various downstream tasks, prompt tuning has emerged as a parameter-efficient fine-tuning method. However, despite its efficiency, the generalization ability of prompt remains limited. In contrast, label smoothing (LS) has been widely recognized as an effective regularization technique that prevents models from becoming over-confident and improves their generalization. This inspires us to explore the integration of LS with prompt tuning. However, we have observed that the vanilla LS even weakens the generalization ability of prompt tuning. To address this issue, we propose the Alternating Training-based Label Smoothing (ATLaS) method, which alternately trains with standard one-hot labels and soft labels generated by LS to supervise the prompt tuning. Moreover, we introduce two types of efficient offline soft labels, including Class-wise Soft Labels (CSL) and Instance-wise Soft Labels (ISL), to provide inter-class or instance-class relationships for prompt tuning. The theoretical properties of the proposed ATLaS method are analyzed. Extensive experiments demonstrate that the proposed ATLaS method, combined with CSL and ISL, consistently enhances the generalization performance of prompt tuning. Moreover, the proposed ATLaS method exhibits high compatibility with prevalent prompt tuning methods, enabling seamless integration into existing methods.

cs.CV↗

Saturation of the kinetic ballooning instability due to the electron parallel nonlinearity

The electron parallel nonlinearity (EPN) is implemented in the gyrokinetic Particle-in-Cell turbulence code GEM [Y. Chen and S. E. Parker, J. Comp. Phys. 220, 839 (2007)]. Application to the Cyclone Base Case reveals a strong effect of EPN on the saturated heat transport above the kinetic ballooning mode threshold. Evidence is provided to show that the strong effect is associated with the electron radial motion due to magnetic fluttering, which turns fine structures of the KBM eigenmode in radius into fine structures in velocity and increases the magnitude of the EPN term in the kinetic equation.

physics.plasm-ph↗

Matrix Autoregressive Model with Vector Time Series Covariates for Spatio-Temporal Data

We develop a new methodology for forecasting matrix-valued time series with historical matrix data and auxiliary vector time series data. We focus on a time series of matrices defined on a static 2-D spatial grid and an auxiliary time series of non-spatial vectors. The proposed model, Matrix AutoRegression with Auxiliary Covariates (MARAC), contains an autoregressive component for the historical matrix predictors and an additive component that maps the auxiliary vector predictors to a matrix response via tensor-vector product. The autoregressive component adopts a bi-linear transformation framework following Chen et al. (2021), significantly reducing the number of parameters. The auxiliary component posits that the tensor coefficient, which maps non-spatial predictors to a spatial response, contains slices of spatially smooth matrix coefficients that are discrete evaluations of smooth functions on a spatial grid from a Reproducing Kernel Hilbert Space (RKHS). We propose to estimate the model parameters under a penalized maximum likelihood estimation framework coupled with an alternating minimization algorithm. We establish the joint asymptotics of the autoregressive and tensor parameters under fixed and high-dimensional regimes. Extensive simulations and a geophysical application for forecasting the global Total Electron Content (TEC) are conducted to validate the performance of MARAC.

stat.ME↗

Absence of Radio Emission Reveals an Exceptionally Weak Explosion of the Putative Historical Supernova Pa 30

We present the first deep radio continuum observations of Pa 30, a nebula hosting a unique optical source driven by an ultrafast outflow with a velocity of 16,000 km s$^{-1}$. The nebula was proposed to be the remnant of a white dwarf merger that occurred in 1181CE. We report no detection of the radio diffuse emission from Pa 30 or radio emission from the central source, setting $3σ$ upper limit flux densities of $0.84\,\rm mJy$ and $0.29\,\rm mJy$ at 1.5 GHz and 6 GHz, respectively, for Pa 30. The radio surface brightness of Pa 30 is $\sim 3$ orders of magnitude smaller than that of typical supernova remnants (SNRs) with comparable angular size. If Pa 30 is an SNR, our observations show it to be the faintest known in the radio band. Considering that 10\% of the supernova (SN) kinetic energy is transferred to cosmic rays (CRs), the absence of radio synchrotron emission suggests that the SN kinetic energy $\lesssim3\times 10^{47}(B/10 μ\rm G)^{-1.65}$ erg, which is 3 to 4 orders of magnitude lower than that of typical SNRs and the lowest measured among Galactic SNRs. There is also an indication of inefficient CR acceleration for this source. The low SN kinetic energy either implies the potential existence of many more radio-faint, sub-energetic SNRs in our Galaxy or challenges the SNR interpretation of Pa 30.

astro-ph.HE↗

Chain-of-Thought Re-ranking for Image Retrieval Tasks

Image retrieval remains a fundamental yet challenging problem in computer vision. While recent advances in Multimodal Large Language Models (MLLMs) have demonstrated strong reasoning capabilities, existing methods typically employ them only for evaluation, without involving them directly in the ranking process. As a result, their rich multimodal reasoning abilities remain underutilized, leading to suboptimal performance. In this paper, we propose a novel Chain-of-Thought Re-Ranking (CoTRR) method to address this issue. Specifically, we design a listwise ranking prompt that enables MLLM to directly participate in re-ranking candidate images. This ranking process is grounded in an image evaluation prompt, which assesses how well each candidate aligns with users query. By allowing MLLM to perform listwise reasoning, our method supports global comparison, consistent reasoning, and interpretable decision-making - all of which are essential for accurate image retrieval. To enable structured and fine-grained analysis, we further introduce a query deconstruction prompt, which breaks down the original query into multiple semantic components. Extensive experiments on five datasets demonstrate the effectiveness of our CoTRR method, which achieves state-of-the-art performance across three image retrieval tasks, including text-to-image retrieval (TIR), composed image retrieval (CIR) and chat-based image retrieval (Chat-IR). Our code is available at https://github.com/freshfish15/CoTRR .

cs.CV↗

Fermi-LAT Detected Gamma-ray Emission Likely Associated with SNR Kes 78

We have analyzed the GeV gamma-ray emission in the region of the supernova remnant (SNR) Kes 78 using $\sim$16.7 years of Fermi-LAT observations and found that the catalog sources 4FGL J1852.4+0037e and 4FGL J1851.8$-$0007c are better represented as two extended sources modeled as `2Ext'. One of them, designated as E2, is located at R.A.$=282.86^\circ$, Dec.$=-0.11^\circ$ with the 68\% containment radius $R_{68} = 0.31^\circ$, and is detected with a significance of 15.2$σ$ in the 0.2--500 GeV energy range. The gamma-ray emission of source E2 is well described by a log-parabola (LogP) spectral model with spectral index $Γ$ = 1.2 and curvature $β$ = 0.3. The fitting with electron-proton number ratio $K_{\rm ep}=0.01$ indicates that the GeV emission of source E2 is dominated by hadronic emission. Given the dense molecular environment surrounding the middle-aged SNR Kes 78, the hadronic scenario provides a natural explanation for the observed GeV emission. The extended source E2 can also be replaced with two point sources. One of them, designated as PTS1, is coincident with the newly discovered PSR J1852$-$0002g within the 68\% positional uncertainty circle, indicating a possible gamma-ray contribution from this PSR. The gamma-ray spectrum of source PTS1 can be well described by a LogP spectral shape. The synchro-curvature radiation model provides a satisfactory spectral fit for source PTS1, suggesting that some of the GeV emission from the Kes 78 region might possibly originate from the magnetosphere of PSR J1852$-$0002g.

astro-ph.HE↗