arXiv subjects

Lei Wang

Publications and source records attributed to Lei Wang.

At least 433 records · Page 24Linked to original sources

arXiv2025

Seasonal Forecasting of Pan-Arctic Sea Ice with State Space Model

The rapid decline of Arctic sea ice resulting from anthropogenic climate change poses significant risks to indigenous communities, ecosystems, and the global climate system. This situation emphasizes the immediate necessity for precise seasonal sea ice forecasts. While dynamical models perform well for short-term forecasts, they encounter limitations in long-term forecasts and are computationally intensive. Deep learning models, while more computationally efficient, often have difficulty managing seasonal variations and uncertainties when dealing with complex sea ice dynamics. In this research, we introduce IceMamba, a deep learning architecture that integrates sophisticated attention mechanisms within the state space model. Through comparative analysis of 25 renowned forecast models, including dynamical, statistical, and deep learning approaches, our experimental results indicate that IceMamba delivers excellent seasonal forecasting capabilities for Pan-Arctic sea ice concentration. Specifically, IceMamba outperforms all tested models regarding average RMSE and anomaly correlation coefficient (ACC) and ranks second in Integrated Ice Edge Error (IIEE). This innovative approach enhances our ability to foresee and alleviate the effects of sea ice variability, offering essential insights for strategies aimed at climate adaptation.

cs.LG↗

arXiv2025

Photoswitchable exceptional points derived from bound states in the continuum

Bound states in the continuum (BICs) and exceptional points (EPs), as two distinct physical singularities represented by complex frequencies in non-Hermitian systems, have garnered significant attention and clear definitions in their respective fields in recent years. They share overlapping applications in areas such as high-sensitivity sensing and laser emission. However, the transition between the two, inspired by these intersections, remains largely unexplored. In this work, we reveal the transition process in a non-Hermitian two-mode system, evolving from one bound singularity to a two-dimensional exceptional ring, where the EP is the coalescent state of the quasi-Friedrich-Wintgen (FW)-BIC. This phenomenon is experimentally validated through pored dielectric metasurfaces in terahertz band. Furthermore, external pumping induced photocarriers as the dissipative perturbation, facilitates the breaking of degeneracy in the complex eigenfrequency and enables dynamic EP switching. Finally, we experimentally demonstrate a switchable terahertz beam deflection driven by the phase singularities of the EP. These findings are instrumental in advancing the development of compact devices for sensing and wavefront control within non-Hermitian systems.

physics.optics↗

arXiv2025

Search for Solar Boosted Dark Matter Particles at the PandaX-4T Experiment

We present a novel constraint on light dark matter utilizing $1.54$ tonne$\cdot$year of data acquired from the PandaX-4T dual-phase xenon time projection chamber. This constraint is derived through detecting electronic recoil signals resulting from the interaction with solar-enhanced dark matter flux. Low-mass dark matter particles, lighter than a few MeV/$c^2$, can scatter with the thermal electrons in the Sun. Consequently, with higher kinetic energy, the boosted dark matter component becomes detectable via contact scattering with xenon electrons, resulting in a few keV energy deposition that exceeds the threshold of PandaX-4T. We calculate the expected recoil energy in PandaX-4T considering the Sun's acceleration and the detection capabilities of the xenon detector. The first experimental search results using the xenon detector yield the most stringent cross-section of $3.51 \times 10^{-39}~\mathrm{cm}^2$ at $0.08~\mathrm{MeV}$/$c^2$ for a solar boosted dark matter mass ranging from $0.02$ to $10~ \mathrm{MeV}$/$c^2$, achieving a 23 fold improvement compared with earlier experimental studies.

hep-ex↗

arXiv2025

SEReDeEP: Hallucination Detection in Retrieval-Augmented Models via Semantic Entropy and Context-Parameter Fusion

Retrieval-Augmented Generation (RAG) models frequently encounter hallucination phenomena when integrating external information with internal parametric knowledge. Empirical studies demonstrate that the disequilibrium between external contextual information and internal parametric knowledge constitutes a primary factor in hallucination generation. Existing hallucination detection methodologies predominantly emphasize either the external or internal mechanism in isolation, thereby overlooking their synergistic effects. The recently proposed ReDeEP framework decouples these dual mechanisms, identifying two critical contributors to hallucinations: excessive reliance on parametric knowledge encoded in feed-forward networks (FFN) and insufficient utilization of external information by attention mechanisms (particularly copy heads). ReDeEP quantitatively assesses these factors to detect hallucinations and dynamically modulates the contributions of FFNs and copy heads to attenuate their occurrence. Nevertheless, ReDeEP and numerous other hallucination detection approaches have been employed at logit-level uncertainty estimation or language-level self-consistency evaluation, inadequately address the semantic dimensions of model responses, resulting in inconsistent hallucination assessments in RAG implementations. Building upon ReDeEP's foundation, this paper introduces SEReDeEP, which enhances computational processes through semantic entropy captured via trained linear probes, thereby achieving hallucination assessments that more accurately reflect ground truth evaluations.

cs.CL↗

arXiv2025

TierBase: A Workload-Driven Cost-Optimized Key-Value Store

In the current era of data-intensive applications, the demand for high-performance, cost-effective storage solutions is paramount. This paper introduces a Space-Performance Cost Model for key-value store, designed to guide cost-effective storage configuration decisions. The model quantifies the trade-offs between performance and storage costs, providing a framework for optimizing resource allocation in large-scale data serving environments. Guided by this cost model, we present TierBase, a distributed key-value store developed by Ant Group that optimizes total cost by strategically synchronizing data between cache and storage tiers, maximizing resource utilization and effectively handling skewed workloads. To enhance cost-efficiency, TierBase incorporates several optimization techniques, including pre-trained data compression, elastic threading mechanisms, and the utilization of persistent memory. We detail TierBase's architecture, key components, and the implementation of cost optimization strategies. Extensive evaluations using both synthetic benchmarks and real-world workloads demonstrate TierBase's superior cost-effectiveness compared to existing solutions. Furthermore, case studies from Ant Group's production environments showcase TierBase's ability to achieve up to 62% cost reduction in primary scenarios, highlighting its practical impact in large-scale online data serving.

cs.DB↗

arXiv2025

A Mechanism-Guided Inverse Engineering Framework to Unlock Design Principles of H-Bonded Organic Frameworks for Gas Separation

The diverse combinations of novel building blocks offer a vast design space for hydrogen-boned frameworks (HOFs), rendering it a great promise for gas separation and purification. However, the underlying separation mechanism facilitated by their unique hydrogen-bond networks has not yet been fully understood. In this work, a comprehensive understanding of the separation mechanisms was achieved through an iterative data-driven inverse engineering approach established upon a hypothetical HOF database possessing nearly 110,000 structures created by a material genomics method. Leveraging a simple yet universal feature extracted from hydrogen bonding information with unambiguous physical meanings, the entire design space was exploited to rapidly identify the optimization route towards novel HOF structures with superior Xe/Kr separation performance (selectivity >103). This work not only provides the first large-scale HOF database, but also demonstrates the enhanced machine learning interpretability of our model-driven iterative inverse design framework, offering new insights into the rational design of nanoporous materials for gas separation.

physics.chem-ph↗

arXiv2025

Spatial-Wavelength Multiplexing Reliable Photonic Integrated General-Purpose Analog Computing System

In the "post-Moore era", the growing challenges in traditional computing have driven renewed interest in analog computing, leading to various proposals for the development of general-purpose analog computing (GPAC) systems. In this work, we present a GPAC prototype featuring a silicon photonic chip designed for fully optical analog computation. This system leverages on-chip multi-channel architectures to enable parallel processing and utilizes wavelength-division multiplexing to significantly enhance computational capacity. In addition, we have developed an error-correction algorithm to monitor processing operations in real time, ensuring the reliability of computational results. Experimentally, we demonstrate the system's capability to solve ordinary differential equations and its applications in communications, microwave photonics, and image processing. The chip's energy efficiency is evaluated to reach up to 227 tera-operations per second per watt. Through this research, we provide a novel hardware framework and innovative directions for analog photonic computing.

physics.optics↗

arXiv2025

Not All Parameters Matter: Masking Diffusion Models for Enhancing Generation Ability

The diffusion models, in early stages focus on constructing basic image structures, while the refined details, including local features and textures, are generated in later stages. Thus the same network layers are forced to learn both structural and textural information simultaneously, significantly differing from the traditional deep learning architectures (e.g., ResNet or GANs) which captures or generates the image semantic information at different layers. This difference inspires us to explore the time-wise diffusion models. We initially investigate the key contributions of the U-Net parameters to the denoising process and identify that properly zeroing out certain parameters (including large parameters) contributes to denoising, substantially improving the generation quality on the fly. Capitalizing on this discovery, we propose a simple yet effective method-termed ``MaskUNet''- that enhances generation quality with negligible parameter numbers. Our method fully leverages timestep- and sample-dependent effective U-Net parameters. To optimize MaskUNet, we offer two fine-tuning strategies: a training-based approach and a training-free approach, including tailored networks and optimization functions. In zero-shot inference on the COCO dataset, MaskUNet achieves the best FID score and further demonstrates its effectiveness in downstream task evaluations. Project page: https://gudaochangsheng.github.io/MaskUnet-Page/

cs.CV↗

arXiv2025

A New Complexity Result for Strongly Convex Optimization with Locally $α$-H{ö}lder Continuous Gradients

In this paper, we present a new complexity result for the gradient descent method with an appropriately fixed stepsize for minimizing a strongly convex function with locally $α$-H{ö}lder continuous gradients ($0 < α\leq 1$). The complexity bound for finding an approximate minimizer with a distance to the true minimizer less than $\varepsilon$ is $O(\log (\varepsilon^{-1}) \varepsilon^{2 α- 2})$, which extends the well-known complexity result for $α= 1$.

math.OC↗

arXiv2025

Transdimensional anomalous Hall effect in rhombohedral thin graphite

Anomalous Hall effect (AHE), occurring in materials with broken time-reversal symmetry, epitomizes the intricate interplay between magnetic order and orbital motions of electrons[1-4]. In two dimensional (2D) systems, AHE is always coupled with out-of-plane orbital magnetization associated in-plane chiral orbital motions. In three dimensional (3D) systems, carriers can tunnel or scatter along the third dimension within the vertical mean free path lz. When sample thickness far exceeds lz, scattering disrupts coherent out-of-plane motion, making 3D AHE effectively a thickness-averaged 2D counterpart[4] -- still governed by out-of-plane orbital magnetization arising from in-plane orbital motions. Here, we explore an uncharted regime where the sample thickness is much larger than the atomic layer thickness yet smaller than or comparable to lz. In such "transdimensional" regime, carriers can sustain coherent orbital motions both within and out of the 2D plane, leading to a fundamentally new type of AHE that couples both out-of-plane and in-plane orbital magnetizations. We report the first observation of such phenomenon -- transdimensional AHE (TDAHE) -- in electrostatically gated rhombohedral ennealayer graphene. This state emerges from a peculiar metallic phase that spontaneously breaks time-reversal, mirror and rotational symmetries driven by electron-electron interactions. Such TDAHE manifests as concurrent out-of-plane and in-plane Hall resistance hysteresis, controlled by external magnetic fields along either direction. Our findings unveils a new class of AHE, opening an unexplored paradigm for correlated and topological physics in transdimensional systems.

cond-mat.mes-hall↗

arXiv2025

A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well?

As enthusiasm for scaling computation (data and parameters) in the pretraining era gradually diminished, test-time scaling (TTS), also referred to as ``test-time computing'' has emerged as a prominent research focus. Recent studies demonstrate that TTS can further elicit the problem-solving capabilities of large language models (LLMs), enabling significant breakthroughs not only in specialized reasoning tasks, such as mathematics and coding, but also in general tasks like open-ended Q&A. However, despite the explosion of recent efforts in this area, there remains an urgent need for a comprehensive survey offering a systemic understanding. To fill this gap, we propose a unified, multidimensional framework structured along four core dimensions of TTS research: what to scale, how to scale, where to scale, and how well to scale. Building upon this taxonomy, we conduct an extensive review of methods, application scenarios, and assessment aspects, and present an organized decomposition that highlights the unique functional roles of individual techniques within the broader TTS landscape. From this analysis, we distill the major developmental trajectories of TTS to date and offer hands-on guidelines for practical deployment. Furthermore, we identify several open challenges and offer insights into promising future directions, including further scaling, clarifying the functional essence of techniques, generalizing to more tasks, and more attributions. Our repository is available on https://github.com/testtimescaling/testtimescaling.github.io/

cs.CL↗

arXiv2025

SignLLM: Sign Language Production Large Language Models

In this paper, we propose SignLLM, a multilingual Sign Language Production (SLP) large language model, which includes two novel multilingual SLP modes MLSF and Prompt2LangGloss that allow sign language gestures generation from query texts input and question-style prompts input respectively. Both modes can use a new RL loss based on reinforcement learning and a new RL module named Priority Learning Channel. These RL components can accelerate the training by enhancing the model's capability to sample high-quality data. To train SignLLM, we introduce Prompt2Sign, a comprehensive multilingual sign language dataset, which builds from public data, including American Sign Language (ASL) and seven others. This dataset standardizes information by extracting pose information from sign language videos into a unified compressed format. We extensively evaluate SignLLM, demonstrating that our model achieves state-of-the-art performance on SLP tasks across eight sign languages.

cs.CV↗

arXiv2025

A Unified Variational Framework for Quantum Excited States

Determining quantum excited states is crucial across physics and chemistry but presents significant challenges for variational methods, primarily due to the need to enforce orthogonality to lower-energy states, often requiring state-specific optimization, penalty terms, or specialized ansatz constructions. We introduce a novel variational principle that overcomes these limitations, enabling the \textit{simultaneous} determination of multiple low-energy excited states. The principle is based on minimizing the trace of the inverse overlap matrix multiplied by the Hamiltonian matrix, $\mathrm{Tr}(\mathbf{S}^{-1}\mathbf{H})$, constructed from a set of \textit{non-orthogonal} variational states $\{|ψ_i\rangle\}$. Here, $\mathbf{H}_{ij} = \langleψ_i | H | ψ_j\rangle$ and $\mathbf{S}_{ij} = \langleψ_i | ψ_j\rangle$ are the elements of the Hamiltonian and overlap matrices, respectively. This approach variationally optimizes the entire low-energy subspace spanned by $\{|ψ_i\rangle\}$ without explicit orthogonality constraints or penalty functions. We demonstrate the power and generality of this method across diverse physical systems and variational ansatzes: calculating the low-energy spectrum of 1D Heisenberg spin chains using matrix product states, finding vibrational spectrum of Morse potential using quantics tensor trains for real-space wavefunctions, and determining excited states for 2D fermionic Hubbard model with variational quantum circuits. In all applications, the method accurately and simultaneously obtains multiple lowest-lying energy levels and their corresponding states, showcasing its potential as a unified and flexible framework for calculating excited states on both classical and quantum computational platforms.

quant-ph↗

arXiv2025

Materials discovery acceleration by using condition generative methodology

With the rapid advancement of AI technologies, generative models have been increasingly employed in the exploration of novel materials. By integrating traditional computational approaches such as density functional theory (DFT) and molecular dynamics (MD), existing generative models, including diffusion models and autoregressive models, have demonstrated remarkable potential in the discovery of novel materials. However, their efficiency in goal-directed materials design remains suboptimal. In this work we developed a highly transferable, efficient and robust conditional generation framework, PODGen, by integrating a general generative model with multiple property prediction models. Based on PODGen, we designed a workflow for the high-throughput crystals conditional generation which is used to search new topological insulators (TIs). Our results show that the success rate of generating TIs using our framework is 5.3 times higher than that of the unconstrained approach. More importantly, while general methods rarely produce gapped TIs, our framework succeeds consistently, highlighting an effectively $\infty$ improvement. This demonstrates that conditional generation significantly enhances the efficiency of targeted material discovery. Using this method, we generated tens of thousands of new topological materials and conducted further first-principles calculations on those with promising application potential. Furthermore, we identified promising, synthesizable topological (crystalline) insulators such as CsHgSb, NaLaB$_{12}$, Bi$_4$Sb$_2$Se$_3$, Be$_3$Ta$_2$Si and Be$_2$W.

cond-mat.mtrl-sci↗

arXiv2025

Region of Synchronization Estimation for Complex Networks via SOS Programming

In this article, we explore the problem of the region of synchronization (ROS) for complex networks with nonlinear dynamics. Given a pair of state- and target- sets, our goal is to estimate the ROS such that the trajectories originating within it reach the target set (i.e., synchronization manifold), without leaving the state set before the first hitting time. In order to do so, an exponential guidance-barrier function is proposed to construct the ROS along the synchronization manifold, and the corresponding sufficient conditions for estimating the ROS are developed. The resulting conditions lead to a sum-of-squares programming problem, thereby affording a polynomial-time solvability. Furthermore, when the synchronization manifold reduces to an equilibrium point, our method not only estimates a larger ROS compared to existing results but also allows the ROS to take more general shapes. Finally, we present two numerical examples to demonstrate the effectiveness of the theoretical results.

math.OC↗

arXiv2025

A Survey on Parameter-Efficient Fine-Tuning for Foundation Models in Federated Learning

Foundation models have revolutionized artificial intelligence by providing robust, versatile architectures pre-trained on large-scale datasets. However, adapting these massive models to specific downstream tasks requires fine-tuning, which can be prohibitively expensive in computational resources. Parameter-Efficient Fine-Tuning (PEFT) methods address this challenge by selectively updating only a small subset of parameters. Meanwhile, Federated Learning (FL) enables collaborative model training across distributed clients without sharing raw data, making it ideal for privacy-sensitive applications. This survey provides a comprehensive review of the integration of PEFT techniques within federated learning environments. We systematically categorize existing approaches into three main groups: Additive PEFT (which introduces new trainable parameters), Selective PEFT (which fine-tunes only subsets of existing parameters), and Reparameterized PEFT (which transforms model architectures to enable efficient updates). For each category, we analyze how these methods address the unique challenges of federated settings, including data heterogeneity, communication efficiency, computational constraints, and privacy concerns. We further organize the literature based on application domains, covering both natural language processing and computer vision tasks. Finally, we discuss promising research directions, including scaling to larger foundation models, theoretical analysis of federated PEFT methods, and sustainable approaches for resource-constrained environments.

cs.LG↗

arXiv2025

Two-dimensional Dual-Switchable Ferroelectric Altermagnets: Altering Electrons and Magnons

Ferroelectric altermagnets (FEAMs) offer unique magnetoelectric coupling properties by combining the characteristics of both antiferromagnets and ferromagnets, yet their multifunctional electric control remains largely unexplored. Here, we introduce and investigate a scenario for the simultaneous electrical switching of electronic spin and magnonic chirality splitting in two-dimensional FEAMs. Based on the C2DB database, employing symmetry analysis and first-principles calculations, we study prototypical candidates CrPS$_3$ and V$_2$I$_2$O$_2$BrCl. We identify the mechanism: ferroelectricity arises from asymmetric displacements (P along $z$ in CrPS$_3$, V along the $xy$-direction in V$_2$I$_2$O$_2$BrCl), which inherently couples electric polarization to both electronic and magnonic degrees of freedom by retaining [C$_2$$||$M] symmetry. Our calculations explicitly demonstrate that reversing the ferroelectric polarization concurrently switches the sign of the electronic spin splitting and chirality of magnonic modes. This shows these materials as dual-switchable FEAMs, enabling unified electrical manipulation of electron and magnon properties. A potentially experimentally detectable method via the magneto-optical Kerr effect was derived. This work provides a materials-specific realization and theoretical basis for designing novel electrically controlled multifunctional spintronic, spin caloritronic, and magnonic devices.

cond-mat.mtrl-sci↗

arXiv2025

TileLang: A Composable Tiled Programming Model for AI Systems

Modern AI workloads rely heavily on optimized computing kernels for both training and inference. These AI kernels follow well-defined data-flow patterns, such as moving tiles between DRAM and SRAM and performing a sequence of computations on those tiles. However, writing high-performance kernels remains complex despite the clarity of these patterns. Achieving peak performance requires careful, hardware-centric optimizations to fully leverage modern accelerators. While domain-specific compilers attempt to reduce the burden of writing high-performance kernels, they often struggle with usability and expressiveness gaps. In this paper, we present TileLang, a generalized tiled programming model for more efficient AI Kernel programming. TileLang decouples scheduling space (thread binding, layout, tensorize and pipeline) from dataflow, and encapsulated them as a set of customization annotations and primitives. This approach allows users to focus on the kernel's data-flow itself, while leaving most other optimizations to compilers. We conduct comprehensive experiments on commonly-used devices, across numerous experiments, our evaluation shows that TileLang can achieve state-of-the-art performance in key kernels, demonstrating that its unified block-and-thread paradigm and transparent scheduling capabilities deliver both the power and flexibility demanded by modern AI system development.

cs.LG↗