arXiv subjects

Wei Ji

Publications and source records attributed to Wei Ji.

At least 73 records · Page 4Linked to original sources

arXiv2025

MVU-Eval: Towards Multi-Video Understanding Evaluation for Multimodal LLMs

The advent of Multimodal Large Language Models (MLLMs) has expanded AI capabilities to visual modalities, yet existing evaluation benchmarks remain limited to single-video understanding, overlooking the critical need for multi-video understanding in real-world scenarios (e.g., sports analytics and autonomous driving). To address this significant gap, we introduce MVU-Eval, the first comprehensive benchmark for evaluating Multi-Video Understanding for MLLMs. Specifically, our MVU-Eval mainly assesses eight core competencies through 1,824 meticulously curated question-answer pairs spanning 4,959 videos from diverse domains, addressing both fundamental perception tasks and high-order reasoning tasks. These capabilities are rigorously aligned with real-world applications such as multi-sensor synthesis in autonomous systems and cross-angle sports analytics. Through extensive evaluation of state-of-the-art open-source and closed-source models, we reveal significant performance discrepancies and limitations in current MLLMs' ability to perform understanding across multiple videos. The benchmark will be made publicly available to foster future research.

cs.CV↗

arXiv2025

Electric-Field-Tunable Luttinger compensated antiferromagnetism in double CrCl2 chains

Luttinger compensated antiferromagnets (LcAFMs), combining spin polarization with vanishing net magnetization, offering distinct advantages for next-generation spintronic applications. Using first-principles calculations, we demonstrate that conventional antiferromagnetic CrCl2 double chains can be transformed into one-dimensional LcAFMs under an external electric field, exhibiting pronounced isotropic spin splitting. The magnitude of the splitting, as well as the band gap, can be effectively tuned by both in-plane and out-of-plane fields, thereby providing greater controllability than in two-dimensional counterparts. To further enhance the tunability, we design a nearly lattice-matched CrCl2/MoTe2 heterostructure and uncover that interfacial charge transfer generates a built-in electric field, inducing spin splitting comparable to that driven by external fields. These results establish interfacial engineering as a highly efficient route to realize and manipulate LcAFM states in low-dimensional magnets, expanding the design principles for spintronic functionalities at the nanoscale.

cond-mat.mtrl-sci↗

arXiv2025

Discretized Gaussian Representation for Tomographic Reconstruction

Computed Tomography (CT) enables detailed cross-sectional imaging but continues to face challenges in balancing reconstruction quality and computational efficiency. While deep learning-based methods have significantly improved image quality and noise reduction, they typically require large-scale training data and intensive computation. Recent advances in scene reconstruction, such as Neural Radiance Fields and 3D Gaussian Splatting, offer alternative perspectives but are not well-suited for direct volumetric CT reconstruction. In this work, we propose Discretized Gaussian Representation (DGR), a novel framework that reconstructs the 3D volume directly using a set of discretized Gaussian functions in an end-to-end manner. To further enhance efficiency, we introduce Fast Volume Reconstruction, a highly parallelized technique that aggregates Gaussian contributions into the voxel grid with minimal overhead. Extensive experiments on both real-world and synthetic datasets demonstrate that DGR achieves superior reconstruction quality and runtime performance across various CT reconstruction scenarios. Our code is publicly available at https://github.com/wskingdom/DGR.

eess.IV↗

arXiv2025

On Efficiency-Effectiveness Trade-off of Diffusion-based Recommenders

Diffusion models have emerged as a powerful paradigm for generative sequential recommendation, which typically generate next items to recommend guided by user interaction histories with a multi-step denoising process. However, the multi-step process relies on discrete approximations, introducing discretization error that creates a trade-off between computational efficiency and recommendation effectiveness. To address this trade-off, we propose TA-Rec, a two-stage framework that achieves one-step generation by smoothing the denoising function during pretraining while alleviating trajectory deviation by aligning with user preferences during fine-tuning. Specifically, to improve the efficiency without sacrificing the recommendation performance, TA-Rec pretrains the denoising model with Temporal Consistency Regularization (TCR), enforcing the consistency between the denoising results across adjacent steps. Thus, we can smooth the denoising function to map the noise as oracle items in one step with bounded error. To further enhance effectiveness, TA-Rec introduces Adaptive Preference Alignment (APA) that aligns the denoising process with user preference adaptively based on preference pair similarity and timesteps. Extensive experiments prove that TA-Rec's two-stage objective effectively mitigates the discretization errors-induced trade-off, enhancing both efficiency and effectiveness of diffusion-based recommenders.

cs.IR↗

arXiv2025

VimoRAG: Video-based Retrieval-augmented 3D Motion Generation for Motion Language Models

This paper introduces VimoRAG, a novel video-based retrieval-augmented motion generation framework for motion large language models (LLMs). As motion LLMs face severe out-of-domain/out-of-vocabulary issues due to limited annotated data, VimoRAG leverages large-scale in-the-wild video databases to enhance 3D motion generation by retrieving relevant 2D human motion signals. While video-based motion RAG is nontrivial, we address two key bottlenecks: (1) developing an effective motion-centered video retrieval model that distinguishes human poses and actions, and (2) mitigating the issue of error propagation caused by suboptimal retrieval results. We design the Gemini Motion Video Retriever mechanism and the Motion-centric Dual-alignment DPO Trainer, enabling effective retrieval and generation processes. Experimental results show that VimoRAG significantly boosts the performance of motion LLMs constrained to text-only input. All the resources are available at https://walkermitty.github.io/VimoRAG/

cs.CV↗

arXiv2025

SEGA: A Stepwise Evolution Paradigm for Content-Aware Layout Generation with Design Prior

In this paper, we study the content-aware layout generation problem, which aims to automatically generate layouts that are harmonious with a given background image. Existing methods usually deal with this task with a single-step reasoning framework. The lack of a feedback-based self-correction mechanism leads to their failure rates significantly increasing when faced with complex element layout planning. To address this challenge, we introduce SEGA, a novel Stepwise Evolution Paradigm for Content-Aware Layout Generation. Inspired by the systematic mode of human thinking, SEGA employs a hierarchical reasoning framework with a coarse-to-fine strategy: first, a coarse-level module roughly estimates the layout planning results; then, another refining module performs fine-level reasoning regarding the coarse planning results. Furthermore, we incorporate layout design principles as prior knowledge into the model to enhance its layout planning ability. Besides, we present GenPoster-100K that is a new large-scale poster dataset with rich meta-information annotation. The experiments demonstrate the effectiveness of our approach by achieving the state-of-the-art results on multiple benchmark datasets. Our project page is at: https://brucew91.github.io/SEGA.github.io/

cs.CV↗

arXiv2025

Anatomically and Metabolically Informed Diffusion for Unified Denoising and Segmentation in Low-Count PET Imaging

Positron emission tomography (PET) image denoising, along with lesion and organ segmentation, are critical steps in PET-aided diagnosis. However, existing methods typically treat these tasks independently, overlooking inherent synergies between them as correlated steps in the analysis pipeline. In this work, we present the anatomically and metabolically informed diffusion (AMDiff) model, a unified framework for denoising and lesion/organ segmentation in low-count PET imaging. By integrating multi-task functionality and exploiting the mutual benefits of these tasks, AMDiff enables direct quantification of clinical metrics, such as total lesion glycolysis (TLG), from low-count inputs. The AMDiff model incorporates a semantic-informed denoiser based on diffusion strategy and a denoising-informed segmenter utilizing nnMamba architecture. The segmenter constrains denoised outputs via a lesion-organ-specific regularizer, while the denoiser enhances the segmenter by providing enriched image information through a denoising revision module. These components are connected via a warming-up mechanism to optimize multi-task interactions. Experiments on multi-vendor, multi-center, and multi-noise-level datasets demonstrate the superior performance of AMDiff.

eess.IV↗

arXiv2025

Detecting gravitational waves with spin systems

The observation of gravitational waves has opened a new window into the Universe through gravitational-wave astronomy. However, high-frequency gravitational waves remain undetected. In this work, we propose that spin systems can be employed to detect gravitational waves in this unexplored frequency regime. We derive the spin's response to gravitational waves and identify three distinct effects: the well-known Gertsenshtein effect, a metric-induced interaction, and the gravitational spin Hall effect. We focus on nuclear spins and utilize nuclear magnetic resonance to enhance the gravitational response, leveraging the advantages of long coherence time, high polarization, and a small gyromagnetic ratio. The proposed experimental scheme is capable of probing gravitational waves in the kilohertz to gigahertz range, with projected sensitivities reaching $\sqrt{S_h}\approx10^{-20}~\mathrm{Hz}^{-1/2}$.

gr-qc↗

arXiv2025

Understanding the atomically precise evolution of the miscibility of newly prepared face-centered cubic W-Cu nanoalloys and its asymmetry

According to classical Miedema theory, reducing crystals to the order of nanometer sizes might greatly modulate the mixing enthalpy of elements, thus enabling the invention of a lot of new bulk-immiscible alloys. Although numerous alloys with higher mixing enthalpies remain unexplored, this strategy is approaching its limit, as reflected by the critical diameter of recent alloys of 1.8 nm, which corresponds to ~150 atoms and hardly provides a crystalline order. Future development requires not only even smaller atomic-scale control but also a new surface energy-saving mechanism. Here, we report the formation of W-Cu nanoalloys with a very large miscibility gap in the bulk via the use of an atomically size-selected cluster beam source as an example. The face-centered cubic (FCC) structure was demonstrated through electron diffraction, which indicated a lattice constant of 3.88Å for W0.85Cu0.15 nanoalloys (~2280 atoms). In this comprehensive study that covers a large parameter space of W/Cu compositions and numbers of atoms, an asymmetric miscibility nanophase diagram in which W-rich compositions favor mixing and the critical size is approximately 6000 atoms, which far exceeds the approximately tens of atoms predicted via classical theory, was obtained for the first time. Density functional theory (DFT) calculations revealed a mutual strain-induced mechanism that simultaneously lowers the surface energies while reducing the size to the atomic scale. This approach paves the way for the development of new high-performance nonequilibrium phase alloys.

cond-mat.mtrl-sci↗

arXiv2025

Step-Audio 2 Technical Report

This paper presents Step-Audio 2, an end-to-end multi-modal large language model designed for industry-strength audio understanding and speech conversation. By integrating a latent audio encoder and reasoning-centric reinforcement learning (RL), Step-Audio 2 achieves promising performance in automatic speech recognition (ASR) and audio understanding. To facilitate genuine end-to-end speech conversation, Step-Audio 2 incorporates the generation of discrete audio tokens into language modeling, significantly enhancing its responsiveness to paralinguistic information such as speaking styles and emotions. To effectively leverage the rich textual and acoustic knowledge in real-world data, Step-Audio 2 integrates retrieval-augmented generation (RAG) and is able to call external tools such as web search to mitigate hallucination and audio search to switch timbres. Trained on millions of hours of speech and audio data, Step-Audio 2 delivers intelligence and expressiveness across diverse conversational scenarios. Evaluation results demonstrate that Step-Audio 2 achieves state-of-the-art performance on various audio understanding and conversational benchmarks compared to other open-source and commercial solutions. Please visit https://github.com/stepfun-ai/Step-Audio2 for more information.

cs.CL↗

arXiv2025

Robust Mottness and tunable interlayer magnetism in Nb3X8 (X = F, Cl, Br, I) bilayers

Kagome materials have attracted extensive attention due to their correlated properties. The breathing kagome material system Nb3X8 (X = F, Cl, Br, I) is regarded as a Mott insulator. However, studies on the influence of interlayer coupling on its magnetic and Mott properties are lacking. In this work, we investigated the effect of interlayer coupling on bilayer properties of each Nb3X8 (X = F, Cl, Br, I) compound via density functional theory (DFT) calculations, considering 24 stacking configurations per material. We found that each bilayer material is a Mott insulator. Due to the competition between interlayer Pauli repulsion and hopping, most interlayer magnetism is AFM, a small number of cases show AFM-FM degeneracy, and the magnetic ground state of 3 configurations is interlayer FM, i.e., tunable interlayer magnetism occurs. This robustness of Mott states coexisting with tunable interlayer magnetism provide novel and comprehensive analysis and insights for the research of breathing kagome Mott insulators.

cond-mat.str-el↗

arXiv2025

NextStep-1: Toward Autoregressive Image Generation with Continuous Tokens at Scale

Prevailing autoregressive (AR) models for text-to-image generation either rely on heavy, computationally-intensive diffusion models to process continuous image tokens, or employ vector quantization (VQ) to obtain discrete tokens with quantization loss. In this paper, we push the autoregressive paradigm forward with NextStep-1, a 14B autoregressive model paired with a 157M flow matching head, training on discrete text tokens and continuous image tokens with next-token prediction objectives. NextStep-1 achieves state-of-the-art performance for autoregressive models in text-to-image generation tasks, exhibiting strong capabilities in high-fidelity image synthesis. Furthermore, our method shows strong performance in image editing, highlighting the power and versatility of our unified approach. To facilitate open research, we will release our code and models to the community.

cs.CV↗

arXiv2025

Anomalous charge density wave in altermagnetism

Exploring the intricate interplay between magnetism and charge density waves has long been a fundamental pursuit at the forefront of condensed matter research. In this letter, based on symmetry analysis and first-principles calculations, we propose for the first time that anomalous charge density wave can be realized in two-dimensional altermagnetic WO. The anomalous charge density wave is characterized by three key features: (i) Unlike conventional charge density wave, whose stabilization is driven by the opening of a gap near the Fermi level, the anomalous charge density wave is stabilized by the occupied states with energies shifting lower far away from the Fermi level; (ii) the anomalous charge density wave increases the density of states near the Fermi level and then enhances-rather than diminishes-the metallicity of materials; (iii) altermagnetism plays a crucial role in stabilizing anomalous charge density wave. Thus, our work offers a pathway for exploring both the realization and the underlying mechanisms of anomalous charge density waves in magnetic systems.

cond-mat.mtrl-sci↗

arXiv2025

Charge-polarized superconducting state emerging in a superatomic antipolar metal

The simultaneous presence of polarity and metallicity or superconductivity in a material signifies the exotic polar metallic or superconducting (SC) state, while such materials are extremely rare due to their exclusive nature. Recently, the interweaved CDW and antipolar charge orders have been discovered in a metallic superatomic crystal of Au6Te12Se8 (ATS), while their interplay and competition with the following emergent SC state remains elusive. Here, we report a further experimental investigation of the SC state emerged from the preformed CDW and antipolar order states using scanning tunneling microscopy/spectroscopy in combination with transport and Raman measurements. The temperature-dependent pre-formation and condensation of Cooper pairs are experimentally identified. The pre-existent CDW is gradually suppressed by the preformed Cooper pairs, and then the antipolar charge order is spatially suppressed into a ferrielectric-like polar order by the condensed Cooper pairs of SC state. The exotic charge-polarized superconducting state is discovered in the polar metal of ATS, suggesting a valuable platform for the exploration of intriguing polar superconducting properties.

cond-mat.supr-con↗

arXiv2025

TAIL: Text-Audio Incremental Learning

Many studies combine text and audio to capture multi-modal information but they overlook the model's generalization ability on new datasets. Introducing new datasets may affect the feature space of the original dataset, leading to catastrophic forgetting. Meanwhile, large model parameters can significantly impact training performance. To address these limitations, we introduce a novel task called Text-Audio Incremental Learning (TAIL) task for text-audio retrieval, and propose a new method, PTAT, Prompt Tuning for Audio-Text incremental learning. This method utilizes prompt tuning to optimize the model parameters while incorporating an audio-text similarity and feature distillation module to effectively mitigate catastrophic forgetting. We benchmark our method and previous incremental learning methods on AudioCaps, Clotho, BBC Sound Effects and Audioset datasets, and our method outperforms previous methods significantly, particularly demonstrating stronger resistance to forgetting on older datasets. Compared to the full-parameters Finetune (Sequential) method, our model only requires 2.42\% of its parameters, achieving 4.46\% higher performance.

cs.SD↗

arXiv2025

Real-space titration and manipulation of particle-like correlated electrons in doped Mott insulator

The localized (particle-like) correlated electrons deserve particular attention as they govern various exotic quantum phenomena, such as quantum spin liquids, Wigner crystals, and Mott insulators in correlated systems. However, direct observation and manipulation of these particle-like electrons at the atomic or single-electron scale remain highly challenging. Here, we successfully realize and directly visualize particle-like correlated electrons in 1T-TaS2 through hole doping. The potential-dependent local electronic structure of single particle-like electron is revealed by angle-resolved photoemission spectroscopy (ARPES), scanning tunneling spectroscopy (STS) combined with theoretical calculations. The complex correlated interactions including nearest-neighbor attractive interactions and many-body repulsive interactions are further demonstrated and discussed based on the spatial distribution of particle-like electrons. Furthermore, the tentative manipulation of the particle-like electrons is successfully achieved by the energy-excitation mechanism. Our results not only provide profound insights into particle-like electrons in correlated systems, but also establish a versatile platform for designing and controlling quantum states at the atomic scale.

cond-mat.str-el↗

arXiv2025

Tunable altermagnetism via inter-chain engineering in parallelassembled atomic chains

Altermagnetism has recently drawn considerable attention in three- and twodimensional materials. Here, we extend this concept to quasi-one-dimensional (Q1D) monolayers assembled from single-atomic magnetic chains. Through systematically examining nine types of structures, two stacking orders, and intra-/inter-chain magnetic couplings, we identify four out of thirty promising structural prototypes for hosting altermagnetism, which yields 192 potential monolayer materials. We further confirm eight thermodynamically stable Q1D monolayers via high-throughput calculations. Using symmetry analysis and first-principles calculations, we find that the existence of altermagnetism is determined by the type of inter-chain magnetic coupling and predict three intrinsic altermagnets,$CrBr_3$,$VBr_3$,$MnBr_3$,due to their ferromagnetic inter-chain couplings and five extrinsic ones,$CrF_3$,$CrCl_3$,$CrI_3$,$FeCl_3$and $CoTe_3$, ascribed to their neglectable or antiferromagnetic inter-chain couplings. Moreover, the inter-chain magnetic coupling here is highly tunable by manipulating the inter-chain spacing, leading to experimentally feasible transitions between altermagnetic and nodal-line semiconducting states. In addition, applying external electric fields can further modulate the spin splitting. Our findings establish a highly tunable family of Q1D altermagnets, offering fundamental insights into the intricate relationship between geometry, electronic structure, and magnetism.These discoveries hold significant promises for experimental realization and future spintronic applications.

cond-mat.mtrl-sci↗

arXiv2025

Cross-Level Multi-Instance Distillation for Self-Supervised Fine-Grained Visual Categorization

High-quality annotation of fine-grained visual categories demands great expert knowledge, which is taxing and time consuming. Alternatively, learning fine-grained visual representation from enormous unlabeled images (e.g., species, brands) by self-supervised learning becomes a feasible solution. However, recent researches find that existing self-supervised learning methods are less qualified to represent fine-grained categories. The bottleneck lies in that the pre-text representation is built from every patch-wise embedding, while fine-grained categories are only determined by several key patches of an image. In this paper, we propose a Cross-level Multi-instance Distillation (CMD) framework to tackle the challenge. Our key idea is to consider the importance of each image patch in determining the fine-grained pre-text representation by multiple instance learning. To comprehensively learn the relation between informative patches and fine-grained semantics, the multi-instance knowledge distillation is implemented on both the region/image crop pairs from the teacher and student net, and the region-image crops inside the teacher / student net, which we term as intra-level multi-instance distillation and inter-level multi-instance distillation. Extensive experiments on CUB-200-2011, Stanford Cars and FGVC Aircraft show that the proposed method outperforms the contemporary method by upto 10.14% and existing state-of-the-art self-supervised learning approaches by upto 19.78% on both top-1 accuracy and Rank-1 retrieval metric.

cs.CV↗