Search arXivSearch

arXiv subjects

Yifei He

Publications and source records attributed to Yifei He.

At least 19 recordsLinked to original sources

Leveraging Visual and Geometric Priors for Metric-scale and Complete Vehicle Gaussian Reconstruction from Limited Views

High-fidelity vehicle assets are essential for controllable traffic scene generation, particularly for synthesizing rare and safety-critical long-tail scenarios. However, reconstructing a reusable vehicle representation from in-the-wild onboard images remains challenging for two reasons. First, image-to-3D generation methods generally produce models without reliable metric scale. Second, onboard cameras usually observe only one side of a target vehicle, making conventional multi-view reconstruction incomplete on unobserved regions. To solve these problems, we propose a feed-forward vehicle asset reconstruction method, which leverages two complementary priors to reconstruct 3D Gaussian representations for vehicles using sparse one-sided observations. To achieve metric-scale reconstruction, a visual foundation model is first utilized to serve as a visual prior for Gaussian initialization. The Gaussian attributes are then estimated by a learnable encoder-decoder module. A symmetry-aware cloning strategy is presented to complete the unobserved side directly in Gaussian space, which exploits the bilateral structure of vehicles as a geometric prior. Experiments on the public dataset demonstrate that the proposed method significantly outperforms existing approaches in both vehicle asset completeness and geometric accuracy.

cs.CV

nuTruck: Benchmarking Autonomous Driving Planning for Distributed Electric-drive Trucks

The dominance of traditional rule-based methods in autonomous driving has gradually been replaced by learning-based approaches. While learning-based planners have achieved considerable success in passenger vehicles, their performance on heavy-duty trucks, particularly modern distributed electric-drive trucks (DETs), remains largely unexplored. To facilitate research and application of learning-based planners in DETs, this letter presents the first high-fidelity benchmark, called nuTruck, designed to support large-scale neural network training and closed-loop evaluation. Given the complex dynamics and high rollover susceptibility of DETs, we first incorporate a highly accurate nonlinear truck dynamical model into the simulation, which enables independent driving and steering of all wheels and captures dynamic load transfer caused by acceleration, deceleration, and cornering, thereby allowing quantitative assessment of rollover risk in closed-loop simulation. Second, we adapt several rule-based and learning-based planners as baselines for DETs and evaluate their performance in closed-loop simulation. Finally, using real-world driving scenarios from the nuPlan dataset, we conduct extensive closed-loop evaluations, analyzing not only conventional collision-free planning performance, but also the dynamical safety of the planned trajectories. The proposed nuTruck benchmark is expected to serve as a new standard for fair and realistic evaluation of autonomous driving planners on DETs.

cs.RO

Dual-Flow Reinforcement Learning with State-Aware Exploration

In complex continuous-control reinforcement learning tasks, multimodal optimal actions often coincide with uncertain, multimodal return distributions, making reliable value estimation and multimodal exploration challenging. Existing value estimation methods using unimodal Gaussians restrict expressiveness and yield biased estimates. Recent generative policies can represent multimodal actions but often collapse to a few modes and under-explore high-value areas of the action space. Motivated by these challenges, we propose Dual-Flow RL, a unified actor-critic framework that jointly models a continuous return distribution and a multimodal policy distribution using conditional flow matching (CFM). This design supports reliable value estimation and sustained multimodal exploration. To further enhance exploration, we introduce an Entropy-Covariance Exploration Regulator (ECER) that enables state-aware exploration regulation leveraging policy entropy and action-uncertainty covariance. Experiments on DeepMind Control Suite and Humanoid-Bench show that Dual-Flow RL achieves state-of-the-art performance on most tasks, significantly outperforming prior diffusion-based and flow-based methods.

cs.LG

Envision4D: Envisioning Visual Futures via Feed-forward 4D Gaussian Splatting for Autonomous Driving

Forecasting the future evolution of dynamic scenes is crucial in autonomous driving. However, existing feed-forward paradigms are primarily designed for interpolation. When extended to future extrapolation, they suffer from ghosting artifacts under large displacements and are constrained by simplified motion assumptions or strict future priors. To overcome these challenges, we propose Envision4D, a fully self-supervised feed-forward framework for pose-free future extrapolation. Specifically, we introduce a Future Pose Prediction module that infers future camera parameters via an iterative denoising process. Furthermore, to capture non-linear dynamics, we propose In-layer Temporal Attention and employ Conditioned Motion Lifting, which transforms the highly uncertain extrapolation process into robust relational mappings. Finally, a Progressive Training Strategy is utilized to stabilize unsupervised motion learning against error accumulation. Extensive experiments demonstrate that Envision4D achieves state-of-the-art performance, significantly outperforming existing methods in future view synthesis.

cs.CV

PRO-CUA: Process-Reward Optimization for Computer Use Agents

Computer use agents (CUAs) have shown strong potential for automating complex digital workflows, yet their training remains constrained by costly live environment interaction and limited high-quality supervision. Existing filtered behavior cloning pipelines suffer from imitation bottlenecks, including distribution shift from the expert demonstration and the absence of negative learning signals. Meanwhile, standard trajectory-level reinforcement learning struggles with sparse rewards, ambiguous credit assignment, and high infrastructure costs for long-horizon GUI interaction. In this work, we propose PRO-CUA, a process-reward optimization framework for training CUAs with iterative step-level reinforcement learning. PRO-CUA decouples on-policy environment interaction from policy optimization: the current policy collects states through live rollouts, generates diverse candidate actions for each state, receives step-level feedback from a process reward model (PRM), and is optimized with group-relative advantages. This design enables dense and flexible credit assignment without relying on golden answers or offline expert trajectories, while reducing distribution shift by training on the agent's own execution states. Experiments on live web benchmarks demonstrate the effectiveness of PRO-CUA and the reliability of PRM-guided step-level training.

cs.AI

In-situ Observation of Magnetostriction Crossover in a Strongly Dipolar Two-Dimensional Bose Gas

Magnetostriction, the anisotropic spatial deformation, is a hallmark of dipolar gases with strong long-range interactions, yet it poses a challenge for in-situ characterization. Here, we observe a magnetostriction crossover from the strongly anisotropic superfluid phase to the nearly isotropic normal phase using in-situ imaging of quasi-two-dimensional 166Er gases. Then, we develop a quasi-2D Hartree-Fock-mean-field framework that provides a robust tool for interaction-aware thermometry, enabling the determination of temperature and chemical potential across all dipole orientations from a single fit. We further demonstrate that the low-density wings effectively obey a local-density equation of state. Finally, we reveals the crossover from the isotropic thermal wings to the anisotropic coherent core in a single in-situ image, providing a pathway for future accurate studies of strongly dipolar superfluidity and thermodynamics in 2D.

cond-mat.quant-gas

Physics-informed Deep Mixture-of-Koopmans Vehicle Dynamics Model with Dual-branch Encoder for Distributed Electric-drive Trucks

Advanced autonomous driving systems require accurate vehicle dynamics modeling. However, identifying a precise dynamics model remains challenging due to strong nonlinearities and the coupled longitudinal and lateral dynamic characteristics. Previous research has employed physics-based analytical models or neural networks to construct vehicle dynamics representations. Nevertheless, these approaches often struggle to simultaneously achieve satisfactory performance in terms of system identification efficiency, modeling accuracy, and compatibility with linear control strategies. In this paper, we propose a fully data-driven dynamics modeling method tailored for complex distributed electric-drive trucks (DETs), leveraging Koopman operator theory to represent highly nonlinear dynamics in a lifted linear embedding space. To achieve high-precision modeling, we first propose a novel dual-branch encoder which encodes dynamic states and provides a powerful basis for the proposed Koopman-based methods entitled KODE. A physics-informed supervision mechanism, grounded in the geometric consistency of temporal vehicle motion, is incorporated into the training process to facilitate effective learning of both the encoder and the Koopman operator. Furthermore, to accommodate the diverse driving patterns of DETs, we extend the vanilla Koopman operator to a mixture-of-Koopman operator framework, enhancing modeling capability. Simulations conducted in a high-fidelity TruckSim environment and real-world experiments demonstrate that the proposed approach achieves state-of-the-art performance in long-term dynamics state estimation.

cs.RO

Dipolar quantum gases: from 3D to Low dimensions

Dipolar quantum gases, encompassing atoms and molecules with significant dipole moments, exhibit unique long-range and anisotropic dipole-dipole interactions (DDI), distinguishing them from systems dominated by short-range contact interactions. This review explores their behavior across dimensions, focusing on magnetic atoms in quasi-2D in comparison to 3D. In 3D, strong DDI leads to phenomena like anisotropic superfluidity, quantum droplets stabilized by Lee-Huang-Yang corrections, and supersolid states with density modulations. In 2D, we discuss a new scenario where DDI induces angle-dependent Berezinskii-Kosterlitz-Thouless transitions and potential supersolidity, as suggested by recent experimental realizations of strongly dipolar systems in quasi-2D geometries. We identify key challenges for future experimental and theoretical work on strongly dipolar 2D systems. The review concludes by highlighting how these unique 2D dipolar systems could advance fundamental research as well as simulate novel physical phenomena.

cond-mat.quant-gas

Observation of a supersolid stripe state in two-dimensional dipolar gases

Fluctuations typically destroy long-range order in two-dimensional (2D) systems, posing a fundamental challenge to the existence of exotic states like supersolids, which paradoxically combine solid-like structure with frictionless superfluid flow. While long-predicted, the definitive observation of a 2D supersolid has remained an outstanding experimental goal. Here, we report the observation of a supersolid stripe phase in a strongly dipolar quantum gas of erbium atoms confined to 2D. We directly image the periodic density modulation, confirming its global phase coherence through matter-wave interference and demonstrating its phase rigidity relevant to the low-energy Goldstone mode, consistent with numerical calculations. Through collective excitation measurements, we demonstrate the hydrodynamic behavior of the supersolid. This work highlights a novel mechanism for supersolid formation in low dimensions, and opens the door for future research on the intricate interplay between temperature, supersolidity, and dimensionality.

cond-mat.quant-gas

WebSTAR: Scalable Data Synthesis for Computer Use Agents with Step-Level Filtering

Computer use agents (CUAs) can operate real-world digital interfaces but remain difficult to train due to the high cost of graphical user interface (GUI) interaction and the scarcity of high-quality trajectory data. Existing datasets rely on human demonstrations, limiting scalability. A natural alternative is to synthesize data from strong CUAs, yet their rollouts are highly noisy, with incorrect or suboptimal actions consisting a large proportion of the steps, making naive imitation ineffective. To tackle this challenge, we introduce a scalable data synthesis pipeline that transforms noisy rollouts into reliable supervision without human annotation. The core idea is step-level filtering, which evaluates actions individually to retain only correct steps, complemented by reasoning augmentation for improved planning. Using this pipeline, we construct WebSTAR, a dataset of 13.3K trajectories and 267K graded, reasoning-rich steps synthesized from OpenAI's computer-use-preview model. We train Qwen-2.5-VL-Instruct models (7B and 32B) on WebSTAR. On WebVoyager, our 7B model surpasses SoTA open-source CUA model UI-TARS-1.5-7B by more than 15% with only supervised finetuning. Building on step-level grading, we further create WebSCORE, a dataset of graded step-level actions, and train StepRM, a 7B multimodal process reward model distilled from o4-mini, which matches its grading quality while being far more efficient to deploy at scale. Our results establish step-level filtering as a key principle for scalable CUA training and construct two new datasets (WebSTAR, WebSCORE) and a lightweight process reward model (StepRM) as practical tools to advance robust and efficient CUAs.

cs.LG

Unveiling the BEC-droplet transition with Rayleigh superradiant scattering

Light scattering plays an essential role in uncovering the properties of quantum states through light-matter interactions. Here, we explore the transition from Bose-Einstein condensate (BEC) to droplets in a dipolar $^{166}$Er gas by employing superradiant light scattering as both a probing and controlling tool. We observe that the efficiency of superradiant scattering exhibits a non-monotonic behavior akin to the rate of sample expansion during the transition, signaling its sensitivity to the initial quantum state, and in turn, revealing the BEC-droplet transition. Through controlled atom depletion via superradiance, we analyze the sample's expansion dynamics and aspect ratio to identify the BEC-droplet phases distinctly, supported by Gaussian variational ansatz calculations. Finally, using these two approaches, we track how the BEC-droplet transition points shift under varying magnetic field orientations. Our work opens new avenues for studying quantum states through superradiance, advancing our understanding of both the BEC-droplet crossover and its coherence properties.

cond-mat.quant-gas

Breaking of scale invariance in a strongly dipolar 2D Bose gas

Two-dimensional (2D) dipolar atomic gases present unique opportunities for exploring novel quantum phases due to their anisotropic and long-range interactions. However, the behavior of strongly dipolar Bose gases in 2D remains unclear, especially when dipoles are tilted. Here, we demonstrate the creation and characterization of strongly dipolar 2D condensates in a quasi-2D harmonic trap with tunable dipole orientation. By investigating scale invariance properties through breathing collective mode measurements, we observe significant breaking of scale invariance when dipoles are tilted in-plane indicating the dominance of the nonlocal dipole-dipole interactions (DDIs) in this regime. Interestingly, the breaking of the scale invariant dynamics is accompanied by an increase in quantum fluctuations, as shown by comparison with mean-field and beyond mean-field theoretical studies. Our experiments also reveal that at critical tilt angles around 70{\deg}, stripe-type density modulations emerge, suggesting the presence of a roton spectrum in 2D, while the system still shows hydrodynamic nature with the phase-locking breathing behavior. This observation elucidates the many-body effect induced by DDIs in 2D, thus marking a crucial step toward realizing 2D supersolids and other exotic quantum phases.

cond-mat.quant-gas

Analytic results in conformal field theory

Since the 1980s, many exact results have been discovered in $2d$ CFT, from critical exponents to correlation functions to complete solutions of certain models. In $d>2$, there is a wealth of numerical results as well as promising analytic approaches, but comparably fewer exact answers. The aim of this conference was to review the most promising analytic methods and results in CFT in any dimension. In particular we tried to understand to which extent the $2d$ methods can be extended to $d>2$, and what is missing to exactly solve $d>2$ CFTs.

hep-th

The Gauge Theory Bootstrap: Predicting pion dynamics from QCD

The Gauge Theory Bootstrap [arXiv:2309.12402, arXiv:2403.10772] computes the strongly coupled pion dynamics by considering the most general scattering matrix, form factors and spectral densities and matching them with perturbative QCD at high energy and with weakly coupled pions at low energy. In this work, we show that further constraints on the spectral densities significantly reduce the possible solutions to a small set of qualitatively similar ones. Quantitatively, the precise solution is controlled by the asymptotic value of the form factors and SVZ sum rules. We also introduce an iterative procedure that, starting from a generic feasible point, converges to a unique solution parameterized by the UV input. For the converged solution we compute masses and widths of resonances that appear, scattering lengths and effective ranges of partial waves, low energy coefficients in the effective action. Additionally, we use these results to discuss the thermodynamics of a pion gas including pair correlations of pions with same and opposite charge.

hep-th

MergeBench: A Benchmark for Merging Domain-Specialized LLMs

Model merging provides a scalable alternative to multi-task training by combining specialized finetuned models through parameter arithmetic, enabling efficient deployment without the need for joint training or access to all task data. While recent methods have shown promise, existing evaluations are limited in both model scale and task diversity, leaving open questions about their applicability to large, domain-specialized LLMs. To tackle the challenges, we introduce MergeBench, a comprehensive evaluation suite designed to assess model merging at scale. MergeBench builds on state-of-the-art open-source language models, including Llama and Gemma families at 2B to 9B scales, and covers five key domains: instruction following, mathematics, multilingual understanding, coding and safety. We standardize finetuning and evaluation protocols, and assess eight representative merging methods across multi-task performance, forgetting and runtime efficiency. Based on extensive experiments, we provide practical guidelines for algorithm selection and share insights showing that model merging tends to perform better on stronger base models, with techniques such as merging coefficient tuning and sparsification improving knowledge retention. However, several challenges remain, including the computational cost on large models, the gap for in-domain performance compared to multi-task models, and the underexplored role of model merging in standard LLM training pipelines. We hope MergeBench provides a foundation for future research to advance the understanding and practical application of model merging. Our project page is at \href{https://yifei-he.github.io/mergebench/}{https://yifei-he.github.io/mergebench/}.

cs.LG

Optimizing FDTD Solvers for Electromagnetics: A Compiler-Guided Approach with High-Level Tensor Abstractions

The Finite Difference Time Domain (FDTD) method is a widely used numerical technique for solving Maxwell's equations, particularly in computational electromagnetics and photonics. It enables accurate modeling of wave propagation in complex media and structures but comes with significant computational challenges. Traditional FDTD implementations rely on handwritten, platform-specific code that optimizes certain kernels while underperforming in others. The lack of portability increases development overhead and creates performance bottlenecks, limiting scalability across modern hardware architectures. To address these challenges, we introduce an end-to-end domain-specific compiler based on the MLIR/LLVM infrastructure for FDTD simulations. Our approach generates efficient and portable code optimized for diverse hardware platforms.We implement the three-dimensional FDTD kernel as operations on a 3D tensor abstraction with explicit computational semantics. High-level optimizations such as loop tiling, fusion, and vectorization are automatically applied by the compiler. We evaluate our customized code generation pipeline on Intel, AMD, and ARM platforms, achieving up to $10\times$ speedup over baseline Python implementation using NumPy.

cs.CL

Efficiently Editing Mixture-of-Experts Models with Compressed Experts

Mixture-of-Experts (MoE) models have become a key approach for scaling large language models efficiently by activating only a subset of experts during training and inference. Typically, the number of activated experts presents a trade-off: fewer experts reduce computational costs, while more experts improve performance. Recent studies reveal that not all activated experts contribute equally to model performance, with some providing minimal utility, particularly when finetuning pretrained MoE models for specialized downstream tasks. The co-existence of significant and redundant parameters in experts provides us an opportunity to reduce the number of activated experts while maintaining model performance. In this work, we propose the concept of compressed experts, lightweight modules that serve as compact representations of full experts. Our approach preserves the most important experts while replacing other auxiliary activated experts with compressed experts. The reduction of active parameters significantly lowers inference costs while achieving comparable performance. Extensive experiments on models including Phi-MoE and OLMoE demonstrate that compressed experts recover over 90% of full expert performance across various tasks while reducing more than 30% active parameters and saving 20% in inference costs. This approach enables efficient deployment of MoE models in resource-constrained settings and facilitates scaling to larger models with manageable overhead. Our code is available at https://github.com/yifei-he/Compressed-Experts.

cs.LG

Task Vector Bases: A Unified and Scalable Framework for Compressed Task Arithmetic

Task arithmetic, representing downstream tasks through linear operations on task vectors, has emerged as a simple yet powerful paradigm for transferring knowledge across diverse settings. However, maintaining a large collection of task vectors introduces scalability challenges in both storage and computation. We propose Task Vector Bases, a framework compressing $T$ task vectors into $M < T$ basis vectors while preserving the functionality of task arithmetic. By representing each task vector as a structured linear combination of basis atoms, our approach supports standard operations such as addition, negation, as well as more advanced arithmetic ones. The framework is orthogonal to other efficiency-oriented improvements in task arithmetic and can be used in combination with them. We provide theoretical analysis showing that basis compression retains addition generalization guarantees and enables principled unlearning, with error bounds depending on reconstruction quality. Empirically, our proposed basis construction methods consistently outperform heuristic basis construction baselines and, in some cases, even surpass the performance of full task vector collections across diverse downstream applications while reducing storage and computational requirements. The code is available at https://github.com/uiuctml/TaskVectorBasis.

cs.LG