arXiv subjects

Cheng Wang

Publications and source records attributed to Cheng Wang.

At least 199 records · Page 11Linked to original sources

arXiv2025

A positivity-preserving, second-order energy stable and convergent numerical scheme for a ternary system of macromolecular microsphere composite hydrogels

A second order accurate numerical scheme is proposed and analyzed for the periodic three-component Macromolecular Microsphere Composite(MMC) hydrogels system, a ternary Cahn-Hilliard system with a Flory-Huggins-deGennes free energy potential. This numerical scheme with energy stability is based on the Backward Differentiation Formula(BDF) method in time derivation combining with Douglas-Dupont regularization term, combined the finite difference method in space. We provide a theoretical justification of positivity-preserving property for all the singular terms, i.e., not only the two phase variables are always between $0$ and $1$, but also the sum of the two phase variables is between $0$ and $1$, at a point-wise level. In addition, an optimal rate convergence analysis is provided in this paper, in which a higher order asymptotic expansion of the numerical solution, the rough error estimate and refined error estimate techniques have to be included to accomplish such an analysis. This paper will be the first to combine the following theoretical properties for a second order accurate numerical scheme for the ternary MMC system: (i) unique solvability and positivity-preserving property; (ii) energy stability; (iii) and optimal rate convergence. A few numerical results are also presented.

math.NA↗

arXiv2024

Mining and Transferring Feature-Geometry Coherence for Unsupervised Point Cloud Registration

Point cloud registration, a fundamental task in 3D vision, has achieved remarkable success with learning-based methods in outdoor environments. Unsupervised outdoor point cloud registration methods have recently emerged to circumvent the need for costly pose annotations. However, they fail to establish reliable optimization objectives for unsupervised training, either relying on overly strong geometric assumptions, or suffering from poor-quality pseudo-labels due to inadequate integration of low-level geometric and high-level contextual information. We have observed that in the feature space, latent new inlier correspondences tend to cluster around respective positive anchors that summarize features of existing inliers. Motivated by this observation, we propose a novel unsupervised registration method termed INTEGER to incorporate high-level contextual information for reliable pseudo-label mining. Specifically, we propose the Feature-Geometry Coherence Mining module to dynamically adapt the teacher for each mini-batch of data during training and discover reliable pseudo-labels by considering both high-level feature representations and low-level geometric cues. Furthermore, we propose Anchor-Based Contrastive Learning to facilitate contrastive learning with anchors for a robust feature space. Lastly, we introduce a Mixed-Density Student to learn density-invariant features, addressing challenges related to density variation and low overlap in the outdoor scenario. Extensive experiments on KITTI and nuScenes datasets demonstrate that our INTEGER achieves competitive performance in terms of accuracy and generalizability.

cs.CV↗

arXiv2024

AdaCo: Overcoming Visual Foundation Model Noise in 3D Semantic Segmentation via Adaptive Label Correction

Recently, Visual Foundation Models (VFMs) have shown a remarkable generalization performance in 3D perception tasks. However, their effectiveness in large-scale outdoor datasets remains constrained by the scarcity of accurate supervision signals, the extensive noise caused by variable outdoor conditions, and the abundance of unknown objects. In this work, we propose a novel label-free learning method, Adaptive Label Correction (AdaCo), for 3D semantic segmentation. AdaCo first introduces the Cross-modal Label Generation Module (CLGM), providing cross-modal supervision with the formidable interpretive capabilities of the VFMs. Subsequently, AdaCo incorporates the Adaptive Noise Corrector (ANC), updating and adjusting the noisy samples within this supervision iteratively during training. Moreover, we develop an Adaptive Robust Loss (ARL) function to modulate each sample's sensitivity to noisy supervision, preventing potential underfitting issues associated with robust loss. Our proposed AdaCo can effectively mitigate the performance limitations of label-free learning networks in 3D semantic segmentation tasks. Extensive experiments on two outdoor benchmark datasets highlight the superior performance of our method.

cs.CV↗

arXiv2024

Efficient cryogenic nonlinear conversion processes in periodically-poled thin-film lithium niobate waveguides

Periodically poled thin-film lithium niobate (TFLN) waveguides, which enable efficient quadratic nonlinear processes, serve as crucial foundation for classical and quantum signal processing. To expand their application scope, we provide the first investigation of nonlinear conversion processes in periodically poled TFLN waveguides at cryogenic condition (7 K). Through systematic experimental characterization, we find that the periodically poled TFLN waveguide retains its high conversion efficiency at both cryogenic and room temperatures for both classical second-harmonic generation and quantum photon-pair generation processes. Particularly, the photon-pair source at cryogenic condition shows high brightness and broad bandwidth. These results demonstrate the significant potential of TFLN wavelength conversion devices for cryogenic applications and foster future scalable quantum photonic systems.

physics.optics↗

arXiv2024

ConDo: Continual Domain Expansion for Absolute Pose Regression

Visual localization is a fundamental machine learning problem. Absolute Pose Regression (APR) trains a scene-dependent model to efficiently map an input image to the camera pose in a pre-defined scene. However, many applications have continually changing environments, where inference data at novel poses or scene conditions (weather, geometry) appear after deployment. Training APR on a fixed dataset leads to overfitting, making it fail catastrophically on challenging novel data. This work proposes Continual Domain Expansion (ConDo), which continually collects unlabeled inference data to update the deployed APR. Instead of applying standard unsupervised domain adaptation methods which are ineffective for APR, ConDo effectively learns from unlabeled data by distilling knowledge from scene-agnostic localization methods. By sampling data uniformly from historical and newly collected data, ConDo can effectively expand the generalization domain of APR. Large-scale benchmarks with various scene types are constructed to evaluate models under practical (long-term) data changes. ConDo consistently and significantly outperforms baselines across architectures, scene types, and data changes. On challenging scenes (Fig.1), it reduces the localization error by >7x (14.8m vs 1.7m). Analysis shows the robustness of ConDo against compute budgets, replay buffer sizes and teacher prediction noise. Comparing to model re-training, ConDo achieves similar performance up to 25x faster.

cs.CV↗

arXiv2024

A New Adversarial Perspective for LiDAR-based 3D Object Detection

Autonomous vehicles (AVs) rely on LiDAR sensors for environmental perception and decision-making in driving scenarios. However, ensuring the safety and reliability of AVs in complex environments remains a pressing challenge. To address this issue, we introduce a real-world dataset (ROLiD) comprising LiDAR-scanned point clouds of two random objects: water mist and smoke. In this paper, we introduce a novel adversarial perspective by proposing an attack framework that utilizes water mist and smoke to simulate environmental interference. Specifically, we propose a point cloud sequence generation method using a motion and content decomposition generative adversarial network named PCS-GAN to simulate the distribution of random objects. Furthermore, leveraging the simulated LiDAR scanning characteristics implemented with Range Image, we examine the effects of introducing random object perturbations at various positions on the target vehicle. Extensive experiments demonstrate that adversarial perturbations based on random objects effectively deceive vehicle detection and reduce the recognition rate of 3D object detection models.

cs.CV↗

arXiv2024

Convergence Analysis of a Preconditioned Steepest Descent Solver for the Cahn-Hilliard Equation with Logarithmic Potential

In this paper, we provide a theoretical analysis for a preconditioned steepest descent (PSD) iterative solver that improves the computational time of a finite difference numerical scheme for the Cahn-Hilliard equation with Flory-Huggins energy potential. In the numerical design, a convex splitting approach is applied to the chemical potential such that the logarithmic and the surface diffusion terms are treated implicitly while the expansive concave term is treated with an explicit update. The nonlinear and singular nature of the logarithmic energy potential makes the numerical implementation very challenging. However, the positivity-preserving property for the logarithmic arguments, unconditional energy stability, and optimal rate error estimates have been established in a recent work and it has been shown that successful solvers ensure a similar positivity-preserving property at each iteration stage. Therefore, in this work, we will show that the PSD solver ensures a positivity-preserving property at each iteration stage. The PSD solver consists of first computing a search direction (involved with solving a Poisson-like equation) and then takes a one-parameter optimization step over the search direction in which the Newton iteration becomes very powerful. A theoretical analysis is applied to the PSD iteration solver and a geometric convergence rate is proved for the iteration. In particular, the strict separation property of the numerical solution, which indicates a uniform distance between the numerical solution and the singular limit values of $\pm 1$ for the phase variable, plays an essential role in the iteration convergence analysis. A few numerical results are presented to demonstrate the robustness and efficiency of the PSD solver.

math.NA↗

arXiv2024

Programmable multifunctional integrated microwave photonic circuit on thin-film lithium niobate

Microwave photonics, with its advanced high-frequency signal processing capabilities, is expected to play a crucial role in next-generation wireless communications and radar systems. The realization of highly integrated, high-performance, and multifunctional microwave photonic links will pave the way for its widespread deployment in practical applications, which is a significant challenge. Here, leveraging thin-film lithium niobate intensity modulator and programmable cascaded microring resonators, we demonstrate for the first time a tunable microwave photonic notch filter that simultaneously achieves high level of integration along with high dynamic range, high link gain, low noise figure, and ultra-high rejection ratio. Additionally, this programmable on-chip system is multifunctional, allowing for the dual-band notch filter and the suppression of the high-power interference signal. This work demonstrates the potential applications of the thin-film lithium niobate platform in the field of high-performance integrated microwave photonic filtering and signal processing, facilitating the advancement of microwave photonic system towards practical applications.

physics.optics↗

arXiv2024

Mono-drive single-sideband modulation via optical delay lines on thin-film lithium niobate

Optical single-sideband (SSB) modulation features high spectral efficiency, substantial dispersion tolerance, and straightforward detection, making it a versatile technology for applications in optical communications, microwave photonics, optical sensing, satellite communication, etc. However, conventional SSB generators typically require two radio-frequency (RF) signals with a 90° phase difference to drive a pair of parallel phase or amplitude modulators, resulting in high system complexity and low power efficiency. In this paper, we propose and realize a simplified SSB generation scheme necessitating only a single RF drive, by achieving effective RF phase shift using on-chip optical delay lines. This approach not only reduces system complexity and saves energy consumption by 3 dB, but also enables easy scalability to higher frequencies. We demonstrate both full-carrier SSB (FC-SSB) and carrier-suppressed SSB (CS-SSB) modulation on thin-film lithium niobate platform. For FC-SSB, we show a maximum sideband suppression of 22.1 dB at 50 GHz and apply it to address the frequency-selective power fading problem in optical communication systems. For CS-SSB, we show a maximum sideband suppression of 22.5 dB and a sideband-to-carrier suppression of 16.9 dB at 50 GHz, which can act as an optical frequency shifter by sweeping the modulation frequencies. Moreover, the shifted optical frequency can be transferred back to the electrical domain by beating with a reference signal generated via a phase modulator on the same chip, achieving broadband RF frequency shifting from a maximum of 50 GHz down to 1 GHz. Our simple, power-efficient, and low-cost SSB modulation scheme could provide an effective solution for future high-frequency direct detection-based communication systems, frequency-modulated continuous wave radar/LiDAR, optical vector network analyzers, and microwave photonics systems.

physics.optics↗

arXiv2024

Large dimensional Spearman's rank correlation matrices: The central limit theorem and its applications

This paper is concerned with Spearman's correlation matrices under large dimensional regime, in which the data dimension diverges to infinity proportionally with the sample size. We establish the central limit theorem for the linear spectral statistics of Spearman's correlation matrices, which extends the results of [\emph{Ann. Statist.} 43(2015) 2588--2623]. We also study the improved Spearman's correlation matrices [\emph{Ann. Math. Statist} 19(1948) 293--325] which is a standard U-statistic of order 3. As applications, we propose three new test statistics for large dimensional independent test and numerical studies demonstrate the applicability of our proposed methods.

math.ST↗

arXiv2024

BiDense: Binarization for Dense Prediction

Dense prediction is a critical task in computer vision. However, previous methods often require extensive computational resources, which hinders their real-world application. In this paper, we propose BiDense, a generalized binary neural network (BNN) designed for efficient and accurate dense prediction tasks. BiDense incorporates two key techniques: the Distribution-adaptive Binarizer (DAB) and the Channel-adaptive Full-precision Bypass (CFB). The DAB adaptively calculates thresholds and scaling factors for binarization, effectively retaining more information within BNNs. Meanwhile, the CFB facilitates full-precision bypassing for binary convolutional layers undergoing various channel size transformations, which enhances the propagation of real-valued signals and minimizes information loss. By leveraging these techniques, BiDense preserves more real-valued information, enabling more accurate and detailed dense predictions in BNNs. Extensive experiments demonstrate that our framework achieves performance levels comparable to full-precision models while significantly reducing memory usage and computational costs.

cs.CV↗

arXiv2024

How interfacial tension enhances drag in turbulent Taylor-Couette flow with neutrally buoyant and equally viscous droplets

The presence of dispersed-phase droplets can result in a notable increase in the system's drag. However, our understanding of the mechanism underlying this phenomenon remains limited. In this study, we use three-dimensional direct numerical simulations with a modified multi-marker volume-of-fluid method to investigate liquid-liquid two-phase turbulence in a Taylor-Couette geometry. The dispersed phase has the same density and viscosity as the continuous phase. The Reynolds number $Re\equiv r_iω_i d/ν$ is fixed at 5200, the volume fraction of the dispersed phase is up to $40\%$, and the Weber number $We\equiv ρu^2_τd/σ$ is around 8. It is found that the increase in the system's drag originates from the contribution of interfacial tension. Specifically, droplets experience significant deformation and stretching in the streamwise direction due to shear near the inner cylinder. Consequently, the rear end of the droplets lags behind the fore head. This causes opposing interfacial tension effects on the fore head and rear end of the droplets. For the fore head of the droplets, the effect of interfacial tension appears to act against the flow direction. For the rear end, the effect appears to act in the flow direction. The increase in the system's drag is primarily attributed to the effect of interfacial tension on the fore head of the droplets which leads to the hindering effect of the droplets on the surrounding continuous phase. This hindering effect disrupts the formation of high-speed streaks, favoring the formation of low-speed ones, which are generally associated with higher viscous stress and drag of the system. This study provides new insights into the mechanism of drag enhancement reported in our previous experiments.

physics.flu-dyn↗

arXiv2024

Similarity-aware Syncretic Latent Diffusion Model for Medical Image Translation with Representation Learning

Non-contrast CT (NCCT) imaging may reduce image contrast and anatomical visibility, potentially increasing diagnostic uncertainty. In contrast, contrast-enhanced CT (CECT) facilitates the observation of regions of interest (ROI). Leading generative models, especially the conditional diffusion model, demonstrate remarkable capabilities in medical image modality transformation. Typical conditional diffusion models commonly generate images with guidance of segmentation labels for medical modal transformation. Limited access to authentic guidance and its low cardinality can pose challenges to the practical clinical application of conditional diffusion models. To achieve an equilibrium of generative quality and clinical practices, we propose a novel Syncretic generative model based on the latent diffusion model for medical image translation (S$^2$LDM), which can realize high-fidelity reconstruction without demand of additional condition during inference. S$^2$LDM enhances the similarity in distinct modal images via syncretic encoding and diffusing, promoting amalgamated information in the latent space and generating medical images with more details in contrast-enhanced regions. However, syncretic latent spaces in the frequency domain tend to favor lower frequencies, commonly locate in identical anatomic structures. Thus, S$^2$LDM applies adaptive similarity loss and dynamic similarity to guide the generation and supplements the shortfall in high-frequency details throughout the training process. Quantitative experiments confirm the effectiveness of our approach in medical image translation. Our code will release lately.

eess.IV↗

arXiv2024

SC3D: Label-Efficient Outdoor 3D Object Detection via Single Click Annotation

LiDAR-based outdoor 3D object detection has received widespread attention. However, training 3D detectors from the LiDAR point cloud typically relies on expensive bounding box annotations. This paper presents SC3D, an innovative label-efficient method requiring only a single coarse click on the bird's eye view of the 3D point cloud for each frame. A key challenge here is the absence of complete geometric descriptions of the target objects from such simple click annotations. To address this issue, our proposed SC3D adopts a progressive pipeline. Initially, we design a mixed pseudo-label generation module that expands limited click annotations into a mixture of bounding box and semantic mask supervision. Next, we propose a mix-supervised teacher model, enabling the detector to learn mixed supervision information. Finally, we introduce a mixed-supervised student network that leverages the teacher model's generalization ability to learn unclicked instances.Experimental results on the widely used nuScenes and KITTI datasets demonstrate that our SC3D with only coarse clicks, which requires only 0.2% annotation cost, achieves state-of-the-art performance compared to weakly-supervised 3D detection methods.The code will be made publicly available.

cs.CV↗

arXiv2024

Brillouin photonics engine in the thin-film lithium niobate platform

Stimulated Brillouin scattering (SBS) is revolutionizing low-noise lasers and microwave photonic systems. However, despite extensive explorations of a low-loss and versatile integrated platform for Brillouin photonic circuits, current options fall short due to limited technological scalability or inadequate SBS gain. Here we introduce the thin-film lithium niobate (TFLN) platform as the go-to choice for integrated Brillouin photonics applications. We report the angle-dependent strong SBS gain in this platform, which can overcome the intrinsic propagation loss. Furthermore, we demonstrate the first stimulated Brillouin laser in TFLN with a tuning range > 20 nm and utilize it to achieve high-purity RF signal generation with an intrinsic linewidth of 9 Hz. Finally, we devise a high-rejection Brillouin-based microwave photonic notch filter, for the first time, integrating an SBS spiral, an on-chip modulator, and a tunable ring all within the same platform. This TFLN-based Brillouin photonics engine uniquely combines the scalability of this platform and the versatility of SBS. Moreover, it bridges SBS with other functionalities in the TFLN platform, unlocking new possibilities for Brillouin-based applications with unparalleled performances.

physics.optics↗

arXiv2024

StoX-Net: Stochastic Processing of Partial Sums for Efficient In-Memory Computing DNN Accelerators

Crossbar-based in-memory computing (IMC) has emerged as a promising platform for hardware acceleration of deep neural networks (DNNs). However, the energy and latency of IMC systems are dominated by the large overhead of the peripheral analog-to-digital converters (ADCs). To address such ADC bottleneck, here we propose to implement stochastic processing of array-level partial sums (PS) for efficient IMC. Leveraging the probabilistic switching of spin-orbit torque magnetic tunnel junctions, the proposed PS processing eliminates the costly ADC, achieving significant improvement in energy and area efficiency. To mitigate accuracy loss, we develop PS-quantization-aware training that enables backward propagation across stochastic PS. Furthermore, a novel scheme with an inhomogeneous sampling length of the stochastic conversion is proposed. When running ResNet20 on the CIFAR-10 dataset, our architecture-to-algorithm co-design demonstrates up to 16x, 8x, and 10x improvement in energy, latency, and area, respectively, compared to IMC with standard ADC. Our optimized design configuration using stochastic PS achieved 130x (24x) improvement in Energy-Delay-Product compared to IMC with full precision ADC (sparse low-bit ADC), while maintaining near-software accuracy at various benchmark classification tasks.

cs.AR↗

arXiv2024

Federated Graph Learning for Cross-Domain Recommendation

Cross-domain recommendation (CDR) offers a promising solution to the data sparsity problem by enabling knowledge transfer across source and target domains. However, many recent CDR models overlook crucial issues such as privacy as well as the risk of negative transfer (which negatively impact model performance), especially in multi-domain settings. To address these challenges, we propose FedGCDR, a novel federated graph learning framework that securely and effectively leverages positive knowledge from multiple source domains. First, we design a positive knowledge transfer module that ensures privacy during inter-domain knowledge transmission. This module employs differential privacy-based knowledge extraction combined with a feature mapping mechanism, transforming source domain embeddings from federated graph attention networks into reliable domain knowledge. Second, we design a knowledge activation module to filter out potential harmful or conflicting knowledge from source domains, addressing the issues of negative transfer. This module enhances target domain training by expanding the graph of the target domain to generate reliable domain attentions and fine-tunes the target model for improved negative knowledge filtering and more accurate predictions. We conduct extensive experiments on 16 popular domains of the Amazon dataset, demonstrating that FedGCDR significantly outperforms state-of-the-art methods.

cs.LG↗

arXiv2024

Hypermultiplexed Integrated-Photonics-based Tensor Optical Processor

The escalating data volume and complexity resulting from the rapid expansion of artificial intelligence (AI), internet of things (IoT) and 5G/6G mobile networks is creating an urgent need for energy-efficient, scalable computing hardware. Here we demonstrate a hypermultiplexed integratedphotonics-based tensor optical processor (HITOP) that can perform trillions of operations per second (TOPS) at the energy efficiency of 40 TOPS/W. Space-time-wavelength three-dimensional (3D) optical parallelism enables O($N^{2}$) operations per clock-cycle using O($N$) modulator devices. The system is built with wafer-fabricated III/V micron-scale lasers and high-speed thin-film Lithium-Niobate electro-optics for encoding at 10s femtojoule/symbol. Lasing threshold incorporates analog inline rectifier (ReLu) nonlinearity for low-latency activation. The system scalability is verified with machine learning models of 405,000 parameters. A combination of high clockrates, energy-efficient processing and programmability unlocks the potential of light for large-scale AI accelerators in applications ranging from training of large AI models to real-time decision making in edge deployment.

cs.ET↗