arXiv subjects

Yuan Gao

Publications and source records attributed to Yuan Gao.

At least 217 records · Page 12Linked to original sources

arXiv2025

SSNet: Flexible and robust channel extrapolation for fluid antenna systems enabled by an self-supervised learning framework

Fluid antenna systems (FAS) signify a pivotal advancement in 6G communication by enhancing spectral efficiency and robustness. However, obtaining accurate channel state information (CSI) in FAS poses challenges due to its complex physical structure. Traditional methods, such as pilot-based interpolation and compressive sensing, are not only computationally intensive but also lack adaptability. Current extrapolation techniques relying on rigid parametric models do not accommodate the dynamic environment of FAS, while data-driven deep learning approaches demand extensive training and are vulnerable to noise and hardware imperfections. To address these challenges, this paper introduces a novel self-supervised learning network (SSNet) designed for efficient and adaptive channel extrapolation in FAS. We formulate the problem of channel extrapolation in FAS as an image reconstruction task. Here, a limited number of unmasked pixels (representing the known CSI of the selected ports) are used to extrapolate the masked pixels (the CSI of unselected ports). SSNet capitalizes on the intrinsic structure of FAS channels, learning generalized representations from raw CSI data, thus reducing dependency on large labelled datasets. For enhanced feature extraction and noise resilience, we propose a mix-of-expert (MoE) module. In this setup, multiple feedforward neural networks (FFNs) operate in parallel. The outputs of the MoE module are combined using a weighted sum, determined by a gating function that computes the weights of each FFN using a softmax function. Extensive simulations validate the superiority of the proposed model. Results indicate that SSNet significantly outperforms benchmark models, such as AGMAE and long short-term memory (LSTM) networks by using a much smaller labelled dataset.

eess.SP↗

arXiv2025

A Real-Time Multi-Model Parametric Representation of Point Clouds

In recent years, parametric representations of point clouds have been widely applied in tasks such as memory-efficient mapping and multi-robot collaboration. Highly adaptive models, like spline surfaces or quadrics, are computationally expensive in detection or fitting. In contrast, real-time methods, such as Gaussian mixture models or planes, have low degrees of freedom, making high accuracy with few primitives difficult. To tackle this problem, a multi-model parametric representation with real-time surface detection and fitting is proposed. Specifically, the Gaussian mixture model is first employed to segment the point cloud into multiple clusters. Then, flat clusters are selected and merged into planes or curved surfaces. Planes can be easily fitted and delimited by a 2D voxel-based boundary description method. Surfaces with curvature are fitted by B-spline surfaces and the same boundary description method is employed. Through evaluations on multiple public datasets, the proposed surface detection exhibits greater robustness than the state-of-the-art approach, with 3.78 times improvement in efficiency. Meanwhile, this representation achieves a 2-fold gain in accuracy over Gaussian mixture models, operating at 36.4 fps on a low-power onboard computer.

cs.CV↗

arXiv2025

Dynamic Adaptive Parsing of Temporal and Cross-Variable Patterns for Network State Classification

Effective network state classification is a primary task for ensuring network security and optimizing performance. Existing deep learning models have shown considerable progress in this area. Some methods excel at analyzing the complex temporal periodicities found in traffic data, while graph-based approaches are adept at modeling the dynamic dependencies between different variables. However, a key trade-off remains, as these methods struggle to capture both characteristics simultaneously. Models focused on temporal patterns often overlook crucial variable dependencies, whereas those centered on dependencies may fail to capture fine-grained temporal details. To address this trade-off, we introduce DAPNet, a framework based on a Mixture-of-Experts architecture. DAPNet integrates three specialized networks for periodic analysis, dynamic cross-variable correlation modeling, and hybrid temporal feature extraction. A learnable gating network dynamically assigns weights to experts based on the input sample and computes a weighted fusion of their outputs. Furthermore, a hybrid regularization loss function ensures stable training and addresses the common issue of class imbalance. Extensive experiments on two large-scale network intrusion detection datasets (CICIDS2017/2018) validate DAPNet's higher accuracy for its target application. The generalizability of the architectural design is evaluated across ten public UEA benchmark datasets, positioning DAPNet as a specialized framework for network state classification.

cs.LG↗

arXiv2025

Towards Human-Level 3D Relative Pose Estimation: Generalizable, Training-Free, with Single Reference

Humans can easily deduce the relative pose of a previously unseen object, without labeling or training, given only a single query-reference image pair. This is arguably achieved by incorporating i) 3D/2.5D shape perception from a single image, ii) render-and-compare simulation, and iii) rich semantic cue awareness to furnish (coarse) reference-query correspondence. Motivated by this, we propose a novel 3D generalizable relative pose estimation method by elaborating 3D/2.5D shape perception with a 2.5D shape from an RGB-D reference, fulfilling the render-and-compare paradigm with an off-the-shelf differentiable renderer, and leveraging the semantic cues from a pretrained model like DINOv2. Specifically, our differentiable renderer takes the 2.5D rotatable mesh textured by the RGB and the semantic maps (obtained by DINOv2 from the RGB input), then renders new RGB and semantic maps (with back-surface culling) under a novel rotated view. The refinement loss comes from comparing the rendered RGB and semantic maps with the query ones, back-propagating the gradients through the differentiable renderer to refine the 3D relative pose. As a result, \emph{our method can be readily applied to unseen objects, given only a single RGB-D reference, without labeling or training}. Extensive experiments on LineMOD, LM-O, and YCB-V show that our training-free method significantly outperforms the state-of-the-art supervised methods, especially under the rigorous \texttt{Acc@5/10/15}$^\circ$ metrics and the challenging cross-dataset settings.

cs.CV↗

arXiv2025

Enhanced Fingerprint-based Positioning With Practical Imperfections: Deep learning-based approaches

High-precision positioning is vital for cellular networks to support innovative applications such as extended reality, unmanned aerial vehicles (UAVs), and industrial Internet of Things (IoT) systems. Existing positioning algorithms using deep learning techniques require vast amounts of labeled data, which are difficult to obtain in real-world cellular environments, and these models often struggle to generalize effectively. To advance cellular positioning techniques, the 2024 Wireless Communication Algorithm Elite Competition as conducted, which provided a dataset from a three-sector outdoor cellular system, incorporating practical challenges such as limited labeled-dataset, dynamic wireless environments within the target and unevenly-spaced anchors, Our team developed three innovative positioning frameworks that swept the top three awards of this competition, namely the semi-supervised framework with consistency, ensemble learning-based algorithm and decoupled mapping heads-based algorithm. Specifically, the semi-supervised framework with consistency effectively generates high-quality pseudo-labels, enlarging the labeled-dataset for model training. The ensemble learning-based algorithm amalgamates the positioning coordinates from models trained under different strategies, effectively combating the dynamic positioning environments. The decoupled mapping heads-based algorithm utilized sector rotation scheme to resolve the uneven-spaced anchor issue. Simulation results demonstrate the superior performance of our proposed positioning algorithms compared to existing benchmarks in terms of the {90%, 80%, 67%, 50%} percentile and mean distance error.

eess.SP↗

arXiv2025

Enabling 6G Through Multi-Domain Channel Extrapolation: Opportunities and Challenges of Generative Artificial Intelligence

Channel extrapolation has attracted wide attention due to its potential to acquire channel state information (CSI) with high accuracy and minimal overhead. This is becoming increasingly crucial as the sixth-generation (6G) mobile networks aim to support complex scenarios, for example, high-mobility communications utilizing ultra-massive multiple-input multiple-output (MIMO) technologies and broad spectrum bands, necessitating multi-domain channel extrapolation. Current research predominantly addresses channel extrapolation within a single domain, lacking a comprehensive approach to multi-domain channel extrapolation. To bridge the gap, we propose the concept of multi-domain channel extrapolation, detailing the essential performance requirements for 6G networks. These include precise channel extrapolation, adaptability to varying scenarios, and manageable computational complexity during both training and inference stages. In light of these requirements, we elaborate the potential and challenges of incorporating generative artificial intelligence (GAI)-based models for effective multi-domain channel extrapolation. Given the ability of the Transformer to capture long-range dependencies and hidden patterns, we propose a novel Transformer encoder-like model by eliminating the positional encoding module and replacing the original multi-head attention with a multilayer perceptron (MLP) for multi-domain channel extrapolation. Simulation results indicate that this model surpasses existing baseline models in terms of extrapolation accuracy and inference speed. Ablation studies further demonstrate the effectiveness of the module design of the proposed design. Finally, we pose several open questions for the development of practical GAI-based multi-domain channel extrapolation models, including the issues of explainability, generalization, and dataset collection.

eess.SP↗

arXiv2025

Apple Intelligence Foundation Language Models: Tech Report 2025

We introduce two multilingual, multimodal foundation language models that power Apple Intelligence features across Apple devices and services: i a 3B-parameter on-device model optimized for Apple silicon through architectural innovations such as KV-cache sharing and 2-bit quantization-aware training; and ii a scalable server model built on a novel Parallel-Track Mixture-of-Experts PT-MoE transformer that combines track parallelism, mixture-of-experts sparse computation, and interleaved global-local attention to deliver high quality with competitive cost on Apple's Private Cloud Compute platform. Both models are trained on large-scale multilingual and multimodal datasets sourced via responsible web crawling, licensed corpora, and high-quality synthetic data, then further refined with supervised fine-tuning and reinforcement learning on a new asynchronous platform. The resulting models support several additional languages while understanding images and executing tool calls. In public benchmarks and human evaluations, both the server model and the on-device model match or surpass comparably sized open baselines. A new Swift-centric Foundation Models framework exposes guided generation, constrained tool calling, and LoRA adapter fine-tuning, allowing developers to integrate these capabilities with a few lines of code. The latest advancements in Apple Intelligence models are grounded in our Responsible AI approach with safeguards like content filtering and locale-specific evaluation, as well as our commitment to protecting our users' privacy with innovations like Private Cloud Compute.

cs.LG↗

arXiv2025

Fast-slow chemical reactions: convergence of Hamilton-Jacobi equation and variational representation

Microscopic behaviors of chemical reactions can be described by a random time-changed Poisson process, whose large-volume limit determines the macroscopic behaviors of species concentrations, including both typical and non-typical trajectories. When the reaction intensities (or fluxes) exhibit a separation of fast-slow scales, the macroscopic typical trajectory is governed by a system of $\varepsilon$-dependent nonlinear reaction rate equations (RRE), while the non-typical trajectories deviating from the typical ones are characterized by an $\varepsilon$-dependent exponentially nonlinear Hamilton-Jacobi equation (HJE). In this paper, for general chemical reactions, we study the fast-slow limit as $\varepsilon\to 0$ for the viscosity solutions of the associated HJE with a state-constrained boundary condition. We identify the limiting effective HJE on a slow manifold, along with an effective variational representation for the solution. Through the uniform convergence of the viscosity solutions and the $Γ$-convergence of the variational solution representations, we rigorously show that all non-typical (and also typical) trajectories are concentrated on the slow manifold and the effective macroscopic dynamics are described by the coarse-grained RRE and HJE, respectively. This approach for studying the fast-slow limit is applicable to, but not limited to, reversible chemical reactions described by gradient flows.

math.AP↗

arXiv2025

Homogenization of Wasserstein gradient flows

We prove the convergence of a Wasserstein gradient flow of a free energy in inhomogeneous media. Both the energy and media can depend on the spatial variable in a fast oscillatory manner. In particular, we show that the gradient-flow structure is preserved in the limit which is expressed in terms of an effective energy and Wasserstein metric. The gradient flow and its limiting behavior are analyzed through an energy dissipation inequality (EDI). The result is consistent with asymptotic analysis in the realm of homogenization. However, we note that the effective metric is in general different from that obtained from the Gromov-Hausdorff convergence of metric spaces. We apply our framework to a linear Fokker-Planck equation but we believe the approach is robust enough to be applicable in a broader context.

math.AP↗

arXiv2025

DualPhys-GS: Dual Physically-Guided 3D Gaussian Splatting for Underwater Scene Reconstruction

In 3D reconstruction of underwater scenes, traditional methods based on atmospheric optical models cannot effectively deal with the selective attenuation of light wavelengths and the effect of suspended particle scattering, which are unique to the water medium, and lead to color distortion, geometric artifacts, and collapsing phenomena at long distances. We propose the DualPhys-GS framework to achieve high-quality underwater reconstruction through a dual-path optimization mechanism. Our approach further develops a dual feature-guided attenuation-scattering modeling mechanism, the RGB-guided attenuation optimization model combines RGB features and depth information and can handle edge and structural details. In contrast, the multi-scale depth-aware scattering model captures scattering effects at different scales using a feature pyramid network and an attention mechanism. Meanwhile, we design several special loss functions. The attenuation scattering consistency loss ensures physical consistency. The water body type adaptive loss dynamically adjusts the weighting coefficients. The edge-aware scattering loss is used to maintain the sharpness of structural edges. The multi-scale feature loss helps to capture global and local structural information. In addition, we design a scene adaptive mechanism that can automatically identify the water-body-type characteristics (e.g., clear coral reef waters or turbid coastal waters) and dynamically adjust the scattering and attenuation parameters and optimization strategies. Experimental results show that our method outperforms existing methods in several metrics, especially in suspended matter-dense regions and long-distance scenes, and the reconstruction quality is significantly improved.

cs.GR↗

arXiv2025

Score Augmentation for Diffusion Models

Diffusion models have achieved remarkable success in generative modeling. However, this study confirms the existence of overfitting in diffusion model training, particularly in data-limited regimes. To address this challenge, we propose Score Augmentation (ScoreAug), a novel data augmentation framework specifically designed for diffusion models. Unlike conventional augmentation approaches that operate on clean data, ScoreAug applies transformations to noisy data, aligning with the inherent denoising mechanism of diffusion. Crucially, ScoreAug further requires the denoiser to predict the augmentation of the original target. This design establishes an equivariant learning objective, enabling the denoiser to learn scores across varied denoising spaces, thereby realizing what we term score augmentation. We also theoretically analyze the relationship between scores in different spaces under general transformations. In experiments, we extensively validate ScoreAug on multiple benchmarks including CIFAR-10, FFHQ, AFHQv2, and ImageNet, with results demonstrating significant performance improvements over baselines. Notably, ScoreAug effectively mitigates overfitting across diverse scenarios, such as varying data scales and model capacities, while exhibiting stable convergence properties. Another advantage of ScoreAug over standard data augmentation lies in its ability to circumvent data leakage issues under certain conditions. Furthermore, we show that ScoreAug can be synergistically combined with traditional data augmentation techniques to achieve additional performance gains.

cs.LG↗

arXiv2025

EvoMakeup: High-Fidelity and Controllable Makeup Editing with MakeupQuad

Facial makeup editing aims to realistically transfer makeup from a reference to a target face. Existing methods often produce low-quality results with coarse makeup details and struggle to preserve both identity and makeup fidelity, mainly due to the lack of structured paired data -- where source and result share identity, and reference and result share identical makeup. To address this, we introduce MakeupQuad, a large-scale, high-quality dataset with non-makeup faces, references, edited results, and textual makeup descriptions. Building on this, we propose EvoMakeup, a unified training framework that mitigates image degradation during multi-stage distillation, enabling iterative improvement of both data and model quality. Although trained solely on synthetic data, EvoMakeup generalizes well and outperforms prior methods on real-world benchmarks. It supports high-fidelity, controllable, multi-task makeup editing -- including full-face and partial reference-based editing, as well as text-driven makeup editing -- within a single model. Experimental results demonstrate that our method achieves superior makeup fidelity and identity preservation, effectively balancing both aspects. Code and dataset will be released upon acceptance.

cs.CV↗

arXiv2025

Universal Magnetocaloric Effect near Quantum Critical Point of Magnon Bose-Einstein Condensation

Bose-Einstein condensation (BEC), a macroscopic quantum phenomenon arising from phase coherence and bosonic statistics, has been realized in quantum magnets. Here, we report the observation of a universal magnetocaloric effect (MCE) near a BEC quantum critical point (QCP) in copper sulfate crystal ($CuSO_4 \cdot 5H_2O$). By conducting magnetocaloric and nuclear magnetic resonance measurements, we uncover a field-driven BEC QCP, evidenced by the universal scaling law $T_c \propto (B_c - B)^{2/3}$ and the perfect data collapse of the magnetic Grüneisen ratio. Thermal excitation triggers a dimensional crossover to a 1D quantum-critical regime, where the MCE scaling strictly matches the universality class of 1D Fermi gases. Notably, the quantum-critical MCE enables cooling down to 12.8 mK without helium-3, with very fast thermal relaxation rate that is critical for high cooling power. This work demonstrates the universal MCE in magnon BEC systems, using a common copper sulfate compound as a paradigmatic example, and paves the way for next-generation sub-Kelvin cooling.

cond-mat.str-el↗

arXiv2025

AI-driven Wireless Positioning: Fundamentals, Standards, State-of-the-art, and Challenges

Wireless positioning technologies hold significant value for applications in autonomous driving, extended reality (XR), unmanned aerial vehicles (UAVs), and more. With the advancement of artificial intelligence (AI), leveraging AI to enhance positioning accuracy and robustness has emerged as a field full of potential. Driven by the requirements and functionalities defined in the 3rd Generation Partnership Project (3GPP) standards, AI/machine learning (ML)-based cellular positioning is becoming a key technology to overcome the limitations of traditional methods. This paper presents a comprehensive survey of AI-driven cellular positioning. We begin by reviewing the fundamentals of wireless positioning and AI models, analyzing their respective challenges and synergies. We provide a comprehensive review of the evolution of 3GPP positioning standards, with a focus on the integration of AI/ML in current and upcoming standard releases. Guided by the 3GPP-defined taxonomy, we categorize and summarize state-of-the-art (SOTA) research into two major classes: AI/ML-assisted positioning and direct AI/ML-based positioning. The former includes line-of-sight (LOS)/non-line-of-sight (NLOS) detection, time of arrival (TOA)/time difference of arrival (TDOA) estimation, and angle prediction; the latter encompasses fingerprinting, knowledge-assisted learning, and channel charting. Furthermore, we review representative public datasets and conduct performance evaluations of AI-based positioning algorithms using these datasets. Finally, we conclude by summarizing the challenges and opportunities of AI-driven wireless positioning.

eess.SP↗

arXiv2025

DepR: Depth Guided Single-view Scene Reconstruction with Instance-level Diffusion

We propose DepR, a depth-guided single-view scene reconstruction framework that integrates instance-level diffusion within a compositional paradigm. Instead of reconstructing the entire scene holistically, DepR generates individual objects and subsequently composes them into a coherent 3D layout. Unlike previous methods that use depth solely for object layout estimation during inference and therefore fail to fully exploit its rich geometric information, DepR leverages depth throughout both training and inference. Specifically, we introduce depth-guided conditioning to effectively encode shape priors into diffusion models. During inference, depth further guides DDIM sampling and layout optimization, enhancing alignment between the reconstruction and the input image. Despite being trained on limited synthetic data, DepR achieves state-of-the-art performance and demonstrates strong generalization in single-view scene reconstruction, as shown through evaluations on both synthetic and real-world datasets.

cs.CV↗

arXiv2025

Fuse Before Transfer: Knowledge Fusion for Heterogeneous Distillation

Most knowledge distillation (KD) methodologies predominantly focus on teacher-student pairs with similar architectures, such as both being convolutional neural networks (CNNs). However, the potential and flexibility of KD can be greatly improved by expanding it to novel Cross-Architecture KD (CAKD), where the knowledge of homogeneous and heterogeneous teachers can be transferred flexibly to a given student. The primary challenge in CAKD lies in the substantial feature gaps between heterogeneous models, originating from the distinction of their inherent inductive biases and module functions. To this end, we introduce an assistant model as a bridge to facilitate smooth feature knowledge transfer between heterogeneous teachers and students. More importantly, within our proposed design principle, the assistant model combines the advantages of cross-architecture inductive biases and module functions by merging convolution and attention modules derived from both student and teacher module functions. Furthermore, we observe that heterogeneous features exhibit diverse spatial distributions in CAKD, hindering the effectiveness of conventional pixel-wise mean squared error (MSE) loss. Therefore, we leverage a spatial-agnostic InfoNCE loss to align features after spatial smoothing, thereby improving the feature alignments in CAKD. Our proposed method is evaluated across some homogeneous model pairs and arbitrary heterogeneous combinations of CNNs, ViTs, and MLPs, achieving state-of-the-art performance for distilled models with a maximum gain of 11.47% on CIFAR-100 and 3.67% on ImageNet-1K. Our code and models will be released.

cs.CV↗

arXiv2025

Hydrodynamic Insight Drives Multimodal Light_Field Dynamics via Streamline Engineering

Since the 1970s, analogies between laser dynamics and fluid systems have provided insight into phenomena such as chaos, multistability, and turbulence. Building on this perspective, we model the optical field as an energy fluid and interpret Poynting-vector trajectories as energy streamlines, yielding a unified, three_dimensional map of light's free-space dynamics. By sculpting these streamlines, we develop an approach to talior vortex-beam propagation dynamics that suppresses both diffraction- and OAM-induced broadening. Extending this method to general structured modes, we enable a single field to exhibit customizable multimodal dynamics that integrate features from primary structured light families: the diffraction-free, self-healing behavior of Bessel beams; the tunable self-similarity of Laguerre-Gaussian beams and adjustable self-acceleration of Airy beams. Additionally, it allows for adjustable propagating energy-density profiles to counteract losses. Optical-tweezer experiments,analogous to particle-tracking velocimetry in fluid dynamics, show that trapped microspheres closely follow the designed streamlines, validating the streamline geometries and indicating a potential route toward precision 3D optomechanical control. In a proof-of-principle free-space communication experiment, vortex beams with customized multimodal dynamics demonstrate several improvements, including more independent channels, reduced turbulence-induced mode scattering, and robust non-line-of-sight transmission. Together, the streamline-engineering approach offers a unified and adaptable strategy for tailoring light's propagation dynamics, with potential applications in precision optomechanics, optofluidics, and advanced optical networking.

physics.optics↗

arXiv2025

From Conditional to Unconditional Independence: Testing Conditional Independence via Transport Maps

Testing conditional independence between two random vectors given a third is a fundamental and challenging problem in statistics, particularly in multivariate nonparametric settings due to the complexity of conditional structures. We propose a novel method for testing conditional independence by transforming it to an unconditional independence test problem. We achieve this by constructing two transport maps that transform conditional independence into unconditional independence, this substantially simplifies the problem. These transport maps are estimated from data using conditional continuous normalizing flow models. Within this framework, we derive a test statistic and prove its asymptotic validity under both the null and alternative hypotheses. A permutation-based procedure is employed to evaluate the significance of the test. We validate the proposed method through extensive simulations and real-data analysis. Our numerical studies demonstrate the practical effectiveness of the proposed method for conditional independence

stat.ML↗