arXiv subjects

Jun Zhang

Publications and source records attributed to Jun Zhang.

At least 289 records · Page 16Linked to original sources

arXiv2025

Observation of Magnetostatic Surface Spin Wave Solitons in Yttrium Iron Garnet Thin Film

Magnetostatic surface spin wave (MSSW) solitons hold great promise for magnonic information processing, but their existence has long been debated. In this work, we resolve this issue by advanced time-resolved Brillouin light scattering (TR-BLS) spectroscopy. We observe long-period MSSW soliton trains in yttrium iron garnet (YIG) thin films by demonstrating their quasiparticle behavior, mode beating, and periodic modulations. We reveal that the MSSW soliton originates from the dipole gap mechanism with a unique comb-like frequency spectrum caused by the four-magnon process. By varying the microwave power, we find significant changes in soliton periods linked to the spin wave dispersion renormalization. Additionally, we report exotic transverse solitons across the YIG thickness. These findings deepen the understanding of nonlinear physics, and pave the way for spin-wave-soliton-based information technologies.

cond-mat.mes-hall↗

arXiv2025

Reg-DPO: SFT-Regularized Direct Preference Optimization with GT-Pair for Improving Video Generation

Recent studies have identified Direct Preference Optimization (DPO) as an efficient and reward-free approach to improving video generation quality. However, existing methods largely follow image-domain paradigms and are mainly developed on small-scale models (approximately 2B parameters), limiting their ability to address the unique challenges of video tasks, such as costly data construction, unstable training, and heavy memory consumption. To overcome these limitations, we introduce a GT-Pair that automatically builds high-quality preference pairs by using real videos as positives and model-generated videos as negatives, eliminating the need for any external annotation. We further present Reg-DPO, which incorporates the SFT loss as a regularization term into the DPO loss to enhance training stability and generation fidelity. Additionally, by combining the FSDP framework with multiple memory optimization techniques, our approach achieves nearly three times higher training capacity than using FSDP alone. Extensive experiments on both I2V and T2V tasks across multiple datasets demonstrate that our method consistently outperforms existing approaches, delivering superior video generation quality.

cs.CV↗

arXiv2025

Constraining $σ_8$ with Lensing Statistics in Low and High Density Regions

Lensing studies are typically carried out around high density regions, such as groups and clusters, where the lensing signals are significant and indicative of rich density structures. However, a more comprehensive test of the cosmological model should also include the lensing effect in low density regions. In this work, we incorporate the stacked weak lensing signals around the low density positions, alongside galaxy-galaxy lensing and galaxy-galaxy two point correlation function to perform a joint cosmological analysis on $σ_8$. The low density positions are constructed from the DR9 data release of the DESI legacy imaging survey, using galaxies with r-band absolute magnitude cut M$<$-21.5 and in the redshift range of 0.18$<$z$<$0.28. In doing so, we simultaneously parameterize photometric redshift errors and halo mass uncertainties while building mock catalogs from simulations using the method of SubHalo Abundance Matching (SHAM). For the weak lensing measurements, we use the shear estimators derived from the DECaLS DR8 imaging data, processed by the Fourier_Quad pipeline. The survey boundaries and masks are fully taken into account. Our analysis achieves a total significance of $31.1σ$ detection for lensing in the low density positions, which significantly improve the $σ_8$ constraint compared to galaxy-galaxy lensing and galaxy-galaxy two point correlation function by 14$\%$. For flat $Λ$CDM model, we constrain $σ_8$ =$0.824^{+0.015}_{-0.015}$, which shows a good agreement with the PLANCK result. Additionally, the halo mass uncertainty $σ_{\lg M}$ and photometric redshift error $σ_z$ are constrained to be $0.565^{+0.086}_{-0.070}$ and $0.004^{+0.004}_{-0.003}$ respectively, which are somewhat different from our expectations due to the significant degeneracy of the two parameters.

astro-ph.CO↗

arXiv2025

Towards General Auditory Intelligence: Large Multimodal Models for Machine Listening and Speaking

In the era of large language models (LLMs) and artificial general intelligence (AGI), computer audition must evolve beyond traditional paradigms to fully leverage the capabilities of foundation models, towards more comprehensive understanding, more natural generation and more human-like interaction. Audio, as a modality rich in semantic, emotional, and contextual cues, plays a vital role in achieving naturalistic and embodied machine intelligence. This survey provides a comprehensive review of recent progress in integrating audio into LLMs, with a focus on four key areas: audio comprehension, audio generation, speech-based interaction, and audio-visual understanding. We analyze how LLMs are reshaping audio perception and reasoning, enabling systems to understand sound at a deeper semantic level, generate expressive audio outputs, and engage in human-like spoken interaction. Furthermore, we explore how the fusion of audio and visual modalities enhances situational awareness and cross-modal reasoning, pushing the boundaries of multimodal intelligence. This survey not only synthesizes existing research but also identifies critical challenges and future directions for building audio-native AGI systems capable of perceiving, understanding, and interacting through sound as naturally as humans do.

eess.AS↗

arXiv2025

Resistance switch in ferromagnet/spin glass/ferromagnet spin valves

We obtain in single van-der-Waals layer of MnBi2Te4 the spin-valve-like ferromagnet/spin glass (SG)/ferromagnet architecture, where the switch of individual spin states in the SG-like layer appears as the resistance switch behavior. The characteristic temperature of SG can be effectively tuned by fine-control of Bi-doping in the SG layer. A doping- and temperature-dependent phase diagram is established. We demonstrate the remote manipulation and detection of the states of individual Mn-layer spins by tunneling electrons in favor of the electron-phonon, spin-phonon, spin-transfer torque and spin-flip interactions among hot electrons, lattice and local spins, where the spin valve layer is even buried below two-quintuple-layer Bi2Te3. The integration of the SG state into spin valves opens the opportunity of realizing atomic-scale spintronics by integrating different degrees of freedom in two dimensional materials.

cond-mat.mtrl-sci↗

arXiv2025

The spin-switch scanning tunneling microscopy: an architecture to probe electron-phonon interactions in the atomic scale

On the spin-valve-like ferromagnet/spin glass/ferromagnet (FM/SG/FM) structure, the tunneling current is dominated by resistance switch (RS) instead of the local density of states according to the conventional tunneling theory. Here we show lattice-site dependent RS behaviors in one-quintuple-layer Bi2Te3 deposited on single MnBi2Te4 septuple layer, which comes from the difference in the efficiency of tunneling electrons to induce focused current or phonons at different sites, switching remotely the spin valve by spin-transfer torque or spin-phonon interactions. These lead to the observation of the dynamic 2-state lattice when the tip scans across the surface as well as the ability of scanning tunneling microscope (STM) to reveal atomic-scale features of electron-phonon (EP) interactions. Our work demonstrates the possibility of the spin-switch STM to image lattice-site dependent EP interactions of any materials deposited on the FM/SG/FM structure.

cond-mat.mtrl-sci↗

arXiv2025

CAS-Spec: Cascade Adaptive Self-Speculative Decoding for On-the-Fly Lossless Inference Acceleration of LLMs

Speculative decoding has become a widely adopted as an effective technique for lossless inference acceleration when deploying large language models (LLMs). While on-the-fly self-speculative methods offer seamless integration and broad utility, they often fall short of the speed gains achieved by methods relying on specialized training. Cascading a hierarchy of draft models promises further acceleration and flexibility, but the high cost of training multiple models has limited its practical application. In this paper, we propose a novel Cascade Adaptive Self-Speculative Decoding (CAS-Spec) method which constructs speculative draft models by leveraging dynamically switchable inference acceleration (DSIA) strategies, including layer sparsity and activation quantization. Furthermore, traditional vertical and horizontal cascade algorithms are inefficient when applied to self-speculative decoding methods. We introduce a Dynamic Tree Cascade (DyTC) algorithm that adaptively routes the multi-level draft models and assigns the draft lengths, based on the heuristics of acceptance rates and latency prediction. Our CAS-Spec method achieves state-of-the-art acceleration compared to existing on-the-fly speculative decoding methods, with an average speedup from $1.1\times$ to $2.3\times$ over autoregressive decoding across various LLMs and datasets. DyTC improves the average speedup by $47$\% and $48$\% over cascade-based baseline and tree-based baseline algorithms, respectively. CAS-Spec can be easily integrated into most existing LLMs and holds promising potential for further acceleration as self-speculative decoding techniques continue to evolve.

cs.LG↗

arXiv2025

Semantic Communications with World Models

Semantic communication is a promising technique for emerging wireless applications, which reduces transmission overhead by transmitting only task-relevant features instead of raw data. However, existing methods struggle under extremely low bandwidth and varying channel conditions, where corrupted or missing semantics lead to severe reconstruction errors. To resolve this difficulty, we propose a world foundation model (WFM)-aided semantic video transmission framework that leverages the predictive capability of WFMs to generate future frames based on the current frame and textual guidance. This design allows transmissions to be omitted when predictions remain reliable, thereby saving bandwidth. Through WFM's prediction, the key semantics are preserved, yet minor prediction errors tend to amplify over time. To mitigate issue, a lightweight depth-based feedback module is introduced to determine whether transmission of the current frame is needed. Apart from transmitting the entire frame, a segmentation-assisted partial transmission method is proposed to repair degraded frames, which can further balance performance and bandwidth cost. Furthermore, an active transmission strategy is developed for mobile scenarios by exploiting camera trajectory information and proactively scheduling transmissions before channel quality deteriorates. Simulation results show that the proposed framework significantly reduces transmission overhead while maintaining task performances across varying scenarios and channel conditions.

eess.IV↗

arXiv2025

Task-Oriented Feature Compression for Multimodal Understanding via Device-Edge Co-Inference

With the rapid development of large multimodal models (LMMs), multimodal understanding applications are emerging. As most LMM inference requests originate from edge devices with limited computational capabilities, the predominant inference pipeline involves directly forwarding the input data to an edge server which handles all computations. However, this approach introduces high transmission latency due to limited uplink bandwidth of edge devices and significant computation latency caused by the prohibitive number of visual tokens, thus hindering delay-sensitive tasks and degrading user experience. To address this challenge, we propose a task-oriented feature compression (TOFC) method for multimodal understanding in a device-edge co-inference framework, where visual features are merged by clustering and encoded by a learnable and selective entropy model before feature projection. Specifically, we employ density peaks clustering based on K nearest neighbors to reduce the number of visual features, thereby minimizing both data transmission and computational complexity. Subsequently, a learnable entropy model with hyperprior is utilized to encode and decode merged features, further reducing transmission overhead. To enhance compression efficiency, multiple entropy models are adaptively selected based on the characteristics of the visual features, enabling a more accurate estimation of the probability distribution. Comprehensive experiments on seven visual question answering benchmarks validate the effectiveness of the proposed TOFC method. Results show that TOFC achieves up to 52% reduction in data transmission overhead and 63% reduction in system latency while maintaining identical task performance, compared with neural compression ELIC.

eess.SP↗

arXiv2025

FAN: Fourier Analysis Networks

Despite the remarkable successes of general-purpose neural networks, such as MLPs and Transformers, we find that they exhibit notable shortcomings in modeling and reasoning about periodic phenomena, achieving only marginal performance within the training domain and failing to generalize effectively to out-of-domain (OOD) scenarios. Periodicity is ubiquitous throughout nature and science. Therefore, neural networks should be equipped with the essential ability to model and handle periodicity. In this work, we propose FAN, a novel neural network that effectively addresses periodicity modeling challenges while offering broad applicability similar to MLP with fewer parameters and FLOPs. Periodicity is naturally integrated into FAN's structure and computational processes by introducing the Fourier Principle. Unlike existing Fourier-based networks, which possess particular periodicity modeling abilities but face challenges in scaling to deeper networks and are typically designed for specific tasks, our approach overcomes this challenge to enable scaling to large-scale models and maintains general-purpose modeling capability. Through extensive experiments, we demonstrate the superiority of FAN in periodicity modeling tasks and the effectiveness and generalizability of FAN across a range of real-world tasks. Moreover, we reveal that compared to existing Fourier-based networks, FAN accommodates both periodicity modeling and general-purpose modeling well.

cs.LG↗

arXiv2025

NTIRE 2025 Challenge on Low Light Image Enhancement: Methods and Results

This paper presents a comprehensive review of the NTIRE 2025 Low-Light Image Enhancement (LLIE) Challenge, highlighting the proposed solutions and final outcomes. The objective of the challenge is to identify effective networks capable of producing brighter, clearer, and visually compelling images under diverse and challenging conditions. A remarkable total of 762 participants registered for the competition, with 28 teams ultimately submitting valid entries. This paper thoroughly evaluates the state-of-the-art advancements in LLIE, showcasing the significant progress.

cs.CV↗

arXiv2025

Precision Measurement of Large Shear Signals

So far, estimators of galaxy shape distortions are only carefully studied perturbatively in the case of small shear signals, mainly for weak lensing science. However, in the neighborhood of massive foreground clusters, a large number of background galaxies can be significantly distorted. The measurement of such large shear signals could be quite nontrivial under general observing conditions, i.e., in the presence of the point spread function (PSF) and noise. In this work, we propose a non-perturbative method to exactly recover large shear signals ($\gtrsim 0.5$) under general conditions. We test the method on simulated galaxy images, and find that it is accurate down to the very faint end. This new method is particularly useful for more accurate recovery of the shear distribution in the neighborhood of massive foreground clusters, thereby improving the modeling of the underlying dark matter halo properties.

astro-ph.CO↗

arXiv2025

WebWeaver: Structuring Web-Scale Evidence with Dynamic Outlines for Open-Ended Deep Research

This paper tackles \textbf{open-ended deep research (OEDR)}, a complex challenge where AI agents must synthesize vast web-scale information into insightful reports. Current approaches are plagued by dual-fold limitations: static research pipelines that decouple planning from evidence acquisition and monolithic generation paradigms that include redundant, irrelevant evidence, suffering from hallucination issues and low citation accuracy. To address these challenges, we introduce \textbf{WebWeaver}, a novel dual-agent framework that emulates the human research process. The planner operates in a dynamic cycle, iteratively interleaving evidence acquisition with outline optimization to produce a comprehensive, citation-grounded outline linking to a memory bank of evidence. The writer then executes a hierarchical retrieval and writing process, composing the report section by section. By performing targeted retrieval of only the necessary evidence from the memory bank via citations for each part, it effectively mitigates long-context issues and citation hallucinations. Our framework establishes a new state-of-the-art across major OEDR benchmarks, including DeepResearch Bench, DeepConsult, and DeepResearchGym. These results validate our human-centric, iterative methodology, demonstrating that adaptive planning and focused synthesis are crucial for producing comprehensive, trusted, and well-structured reports.

cs.CL↗

arXiv2025

SCI-Reason: A Dataset with Chain-of-Thought Rationales for Complex Multimodal Reasoning in Academic Areas

Large Language Models (LLMs) and Large Multimodal Models (LMMs) demonstrate impressive problem-solving skills in many tasks and domains. However, their ability to reason with complex images in academic domains has not been systematically investigated. To bridge this gap, we present SCI-Reason, a dataset for complex multimodel reasoning in academic areas. SCI-Reason aims to test and improve the reasoning ability of large multimodal models using real complex images in academic domains. The dataset contains 12,066 images and 12,626 question-answer pairs extracted from PubMed, divided into training, validation and test splits. Each question-answer pair also contains an accurate and efficient inference chain as a guide to improving the inference properties of the dataset. With SCI-Reason, we performed a comprehensive evaluation of 8 well-known models. The best performing model, Claude-3.7-Sonnet, only achieved an accuracy of 55.19%. Error analysis shows that more than half of the model failures are due to breakdowns in multi-step inference chains rather than errors in primary visual feature extraction. This finding underscores the inherent limitations in reasoning capabilities exhibited by current multimodal models when processing complex image analysis tasks within authentic academic contexts. Experiments on open-source models show that SCI-Reason not only enhances reasoning ability but also demonstrates cross-domain generalization in VQA tasks. We also explore future applications of model inference capabilities in this domain, highlighting its potential for future research.

cs.MM↗

arXiv2025

Observation of non-Hermitian topology in cold Rydberg quantum gases

The pursuit of topological phenomena in non-Hermitian systems has unveiled new physics beyond the conventional Hermitian paradigm, yet their realization in interacting many-body platforms remains a critical challenge. Exploring this interplay is essential to understand how strong interactions and dissipation collectively shape topological phases in open quantum systems. Here, we experimentally demonstrate non-Hermitian spectra topology in a dissipative Rydberg atomic gas and characterize parameters-dependent winding numbers. By increasing the interaction strength, the system evolves from Hermitian to non-Hermitian regime, accompanying emergence of trajectory loop in the complex energy plane. As the scanning time is varied, the spectra topology becomes twisted in the complex energy plane manifesting as a topology phase transition with the sign winding number changed. When preparing the system in different initial states, we can access a nontrivial fractional phase within a parameter space that globally possesses an integer winding. Furthermore, by changing the scanning direction, we observe the differentiated loops, revealing the breaking of chirality symmetry. This work establishes cold Rydberg gases as a versatile platform for exploring the rich interplay between non-Hermitian topology, strong interactions, and dissipative quantum dynamics.

cond-mat.quant-gas↗

arXiv2025

Quantum Zeno Effect in the Spatial Evolution of a Single Atom

The quantum Zeno effect (QZE) reveals that frequent measurements can suppress quantum evolution, but the detailed dynamics of the system under finite-duration measurements in experiments remain insufficiently explored. Here, we employ an optical dipole trap as a projective measurement to study the motion of a single cold atom in free space. By monitoring atomic loss, we directly observe the QZE in single-atom motion in free space and find that the effect of dipole measurements on the atom comprises a short-time collapse followed by subsequent periodic unitary evolution, thereby providing an intuitive physical picture of measurement backaction across different timescales. We further investigate the effects of measurement frequency, strength, and spatial position, demonstrating that measurements not only suppress the spreading of quantum states but also enable deterministic preparation of distinct motional states. Furthermore, by dynamically controlling the measurement position, we achieve measurement-induced directional transport of a single atom without imparting additional momentum. Our results provide a direct experimental demonstration of the QZE in real space and establish a versatile framework for measurement-based control of atomic motion, paving the way for motional-state engineering in cold-atom platforms.

quant-ph↗

arXiv2025

PixelCraft: A Multi-Agent System for High-Fidelity Visual Reasoning on Structured Images

Structured images (e.g., charts and geometric diagrams) remain challenging for multimodal large language models (MLLMs), as perceptual slips can cascade into erroneous conclusions. Intermediate visual cues can steer reasoning; however, existing cue-based methods are constrained with low-fidelity image processing and linear, rigid reasoning patterns, limiting their effectiveness on complex structured-image tasks. In this paper, we propose PixelCraft, a novel multi-agent system for high-fidelity image processing and flexible visual reasoning on structured images. The system comprises a dispatcher, a planner, a reasoner, critics, and a set of visual tool agents. To achieve high-fidelity processing, we construct a high-quality corpus and fine-tune an MLLM into a grounding model, whose pixel-level localizations are integrated with traditional computer vision (CV) algorithms in tool agents. Building on this foundation, PixelCraft facilitates flexible visual reasoning through a dynamic three-stage workflow of tool selection, agent discussion, and self-criticism. Moreover, unlike prior linear reasoning patterns that simply append historical images, PixelCraft maintains an image memory to allow the planner to adaptively revisit earlier visual steps, explore alternative reasoning branches, and dynamically adjust the reasoning trajectory during discussion. Extensive experiments on challenging chart and geometry benchmarks demonstrate that PixelCraft significantly improves visual reasoning performance for advanced MLLMs, setting a new standard for structured image reasoning. Our code will be available at https://github.com/microsoft/PixelCraft.

cs.CV↗

arXiv2025

Foundation Model-Based Adaptive Semantic Image Transmission for Dynamic Wireless Environments

Foundation model-based semantic transmission has recently shown great potential in wireless image communication. However, existing methods exhibit two major limitations: (i) they overlook the varying importance of semantic components for specific downstream tasks, and (ii) they insufficiently exploit wireless domain knowledge, resulting in limited robustness under dynamic channel conditions. To overcome these challenges, this paper proposes a foundation model-based adaptive semantic image transmission system for dynamic wireless environments, such as autonomous driving. The proposed system decomposes each image into a semantic segmentation map and a compressed representation, enabling task-aware prioritization of critical objects and fine-grained textures. A task-adaptive precoding mechanism then allocates radio resources according to the semantic importance of extracted features. To ensure accurate channel information for precoding, a channel estimation knowledge map (CEKM) is constructed using a conditional diffusion model that integrates user position, velocity, and sparse channel samples to train scenario-specific lightweight estimators. At the receiver, a conditional diffusion model reconstructs high-quality images from the received semantic features, ensuring robustness against channel impairments and partial data loss. Simulation results on the BDD100K dataset with multi-scenario channels generated by QuaDRiGa demonstrate that the proposed method outperforms existing approaches in terms of perceptual quality (SSIM, LPIPS, FID), task-specific accuracy (IoU), and transmission efficiency. These results highlight the effectiveness of integrating task-aware semantic decomposition, scenario-adaptive channel estimation, and diffusion-based reconstruction for robust semantic transmission in dynamic wireless environments.

eess.IV↗