arXiv subjects

Jie Li

Publications and source records attributed to Jie Li.

At least 325 records · Page 18Linked to original sources

arXiv2024

Neutrinos in the flavor-dependent $U(1)_F$ model

The neutrino oscillation experiments provide definitive evidence of new physics beyond the Standard Model (SM), and the neutrino mass-squared differences and flavor mixing have been precisely measured. This study examines the neutrino sector within the flavor-dependent $U(1)_F$ model, where the unique fermion sector can simultaneously address both the flavor mixing puzzle and the mass hierarchy puzzle. It is found that the lightest neutrino is naturally massless in this model, and the predicted neutrino mass-squared differences, flavor mixing angles, Dirac CP phase agree well with the experimental measurements. Additionally, the effects of the Dirac CP phase and Majorana CP phase on the theoretical predictions of the neutrino transition magnetic dipole moments are analyzed.

hep-ph↗

arXiv2024

Inference-to-complete: A High-performance and Programmable Data-plane Co-processor for Neural-network-driven Traffic Analysis

Neural-networks-driven intelligent data-plane (NN-driven IDP) is becoming an emerging topic for excellent accuracy and high performance. Meanwhile we argue that NN-driven IDP should satisfy three design goals: the flexibility to support various NNs models, the low-latency-high-throughput inference performance, and the data-plane-unawareness harming no performance and functionality. Unfortunately, existing work either over-modify NNs for IDP, or insert inline pipelined accelerators into the data-plane, failing to meet the flexibility and unawareness goals. In this paper, we propose Kaleidoscope, a flexible and high-performance co-processor located at the bypass of the data-plane. To address the challenge of meeting three design goals, three key techniques are presented. The programmable run-to-completion accelerators are developed for flexible inference. To further improve performance, we design a scalable inference engine which completes low-latency and low-cost inference for the mouse flows, and perform complex NNs with high-accuracy for the elephant flows. Finally, raw-bytes-based NNs are introduced, which help to achieve unawareness. We prototype Kaleidoscope on both FPGA and ASIC library. In evaluation on six NNs models, Kaleidoscope reaches 256-352 ns inference latency and 100 Gbps throughput with negligible influence on the data-plane. The on-board tested NNs perform state-of-the-art accuracy among other NN-driven IDP, exhibiting the the significant impact of flexibility on enhancing traffic analysis accuracy.

cs.NI↗

arXiv2024

Tetragonal BaCoO$_3$: A Co$^{4+}$ Ferromagnetic Mott Insulator with Inverted Spin Crossover

The interplay between crystal electric field splitting of d states and Hund's rule exchange energy in cobalt-based perovskites offers a promising avenue for inducing spin-state transitions. This study reports a new body-centered tetragonal (BCT) phase of BaCoO$_3$ (BCT-BaCoO$_3$), synthesized under high pressure (15 GPa) and high temperature (1200 °C) conditions. BCT-BaCoO$_3$ adopts a double perovskite structure of EuTiO$_3$-type (space group I4/mcm, #140), confirmed by high-resolution scanning transmission electron microscopy. X-ray photoelectron spectroscopy reveals a rare Co$^{4+}$ valence state. Magnetization and X-ray absorption measurements reveal a low-spin to high-spin transition that takes place between 200 and 300 K. While spin crossovers are relatively common among common oxides, the one observed in BCT-BaCoO$_3$ is remarkable in that it proceeds in the opposite direction from conventional spin transitions. BCT-BaCoO$_3$ exhibits a low-spin (S = 1/2) state at high temperatures and transitions to a high-spin (S = 5/2) state at low temperatures. Within the high-spin state, hard ferromagnetic order onsets at T$_C$ = 107 K. Electrical resistivity indicates weak magnetoresistance and insulating behavior. Overall, BCT-BaCoO$_3$ presents an exceptional model for the exploration of spin-state transitions and the study of Co spin states in cobalt-based perovskites.

cond-mat.mtrl-sci↗

arXiv2024

Entangling two exciton modes using exciton optomechanics

Exciton optomechanics, bridging cavity exciton polaritons and optomechanics, opens new opportunities for the study of light-matter strong interactions and nonlinearities, due to the rich nonlinear couplings among excitons, phonons, and photons. Here, we propose to entangle two exciton modes in an exciton-optomechanics system, which consists of a semiconductor microcavity integrated with two quantum wells. The quantum wells support two exciton modes, which simultaneously couple to an optical cavity mode via a linear dipole interaction and to a mechanical vibration mode via a nonlinear deformation potential interaction. We show that by strongly driving the microcavity with a red-detuned laser field and when the two exciton modes are respectively resonant with the Stokes and anti-Stokes sidebands scattered by the mechanical motion, stationary entanglement between the two exciton modes can be established under realistic parameters. The protocol is within reach of current technology and may become a promising approach for preparing excitonic entanglement.

quant-ph↗

arXiv2024

Model reduction, machine learning based global optimisation for large-scale steady state nonlinear systems

Many engineering processes can be accurately modelled using partial differential equations (PDEs), but high dimensionality and non-convexity of the resulting systems pose limitations on their efficient optimisation. In this work, a model reduction, machine-learning methodology combining principal component analysis (PCA) and artificial neural networks (ANNs) is employed to construct a reduced surrogate model, which can then be utilised by advanced deterministic global optimisation algorithms to compute global optimal solutions with theoretical guarantees. However, such optimisation would still be time-consuming due to the high non-convexity of the activation functions inside the reduced ANN structures. To develop a computationally-efficient optimisation framework, we propose two alternative strategies: The first one is a piecewise-affine reformulation of the nonlinear ANN activation functions, while the second one is based on deep rectifier neural networks with ReLU activation function. The performance of the proposed framework is demonstrated through two illustrative case studies.

math.OC↗

arXiv2024

Magnon squeezing via reservoir-engineered optomagnomechanics

We show how to prepare magnonic squeezed states in an optomagnomechanical system, in which magnetostriction induced mechanical displacement couples to an optical cavity via radiation pressure. We discuss two scenarios depending on whether the magnomechanical coupling is linear or dispersive. We show that in both cases the strong mechanical squeezing obtained via two-tone driving of the optical cavity can be efficiently transferred to the magnon mode. In the linear coupling case, stationary magnon squeezing is achieved; while in the dispersive coupling case, a transient magnonic squeezed state is prepared in a two-step protocol. The proposed magnonic squeezed states find promising applications in quantum information processing and quantum sensing using magnons.

quant-ph↗

arXiv2024

A boundary-aware point clustering approach in Euclidean and embedding spaces for roof plane segmentation

Roof plane segmentation from airborne LiDAR point clouds is an important technology for 3D building model reconstruction. One of the key issues of plane segmentation is how to design powerful features that can exactly distinguish adjacent planar patches. The quality of point feature directly determines the accuracy of roof plane segmentation. Most of existing approaches use handcrafted features to extract roof planes. However, the abilities of these features are relatively low, especially in boundary area. To solve this problem, we propose a boundary-aware point clustering approach in Euclidean and embedding spaces constructed by a multi-task deep network for roof plane segmentation. We design a three-branch network to predict semantic labels, point offsets and extract deep embedding features. In the first branch, we classify the input data as non-roof, boundary and plane points. In the second branch, we predict point offsets for shifting each point toward its respective instance center. In the third branch, we constrain that points of the same plane instance should have the similar embeddings. We aim to ensure that points of the same plane instance are close as much as possible in both Euclidean and embedding spaces. However, although deep network has strong feature representative ability, it is still hard to accurately distinguish points near plane instance boundary. Therefore, we first group plane points into many clusters in the two spaces, and then we assign the rest boundary points to their closest clusters to generate final complete roof planes. In this way, we can effectively reduce the influence of unreliable boundary points. In addition, we prepare a synthetic dataset and two real datasets to train and evaluate our approach. The experiments results show that the proposed approach significantly outperforms the existing state-of-the-art approaches.

cs.CV↗

arXiv2024

Morphology and Behavior Co-Optimization of Modular Satellites for Attitude Control

The emergence of modular satellites marks a significant transformation in spacecraft engineering, introducing a new paradigm of flexibility, resilience, and scalability in space exploration endeavors. In addressing complex challenges such as attitude control, both the satellite's morphological architecture and the controller are crucial for optimizing performance. Despite substantial research on optimal control, there remains a significant gap in developing optimized and practical assembly strategies for modular satellites tailored to specific mission constraints. This research gap primarily arises from the inherently complex nature of co-optimizing design and control, a process known for its notorious bi-level optimization loop. Conventionally tackled through artificial evolution, this issue involves optimizing the morphology based on the fitness of individual controllers, which is sample-inefficient and computationally expensive. In this paper, we introduce a novel gradient-based approach to simultaneously optimize both morphology and control for modular satellites, enhancing their performance and efficiency in attitude control missions. Our Monte Carlo simulations demonstrate that this co-optimization approach results in modular satellites with better mission performance compared to those designed by evolution-based approaches. Furthermore, this study discusses potential avenues for future research.

cs.RO↗

arXiv2024

Speaker Contrastive Learning for Source Speaker Tracing

As a form of biometric authentication technology, the security of speaker verification systems is of utmost importance. However, SV systems are inherently vulnerable to various types of attacks that can compromise their accuracy and reliability. One such attack is voice conversion, which modifies a persons speech to sound like another person by altering various vocal characteristics. This poses a significant threat to SV systems. To address this challenge, the Source Speaker Tracing Challenge in IEEE SLT2024 aims to identify the source speaker information in manipulated speech signals. Specifically, SSTC focuses on source speaker verification against voice conversion to determine whether two converted speech samples originate from the same source speaker. In this study, we propose a speaker contrastive learning-based approach for source speaker tracing to learn the latent source speaker information in converted speech. To learn a more source-speaker-related representation, we employ speaker contrastive loss during the training of the embedding extractor. This speaker contrastive loss helps identify the true source speaker embedding among several distractor speaker embeddings, enabling the embedding extractor to learn the potentially possessing source speaker information present in the converted speech. Experiments demonstrate that our proposed speaker contrastive learning system achieves the lowest EER of 16.788% on the challenge test set, securing first place in the challenge.

cs.SD↗

arXiv2024

Infrared and Visible Image Fusion with Hierarchical Human Perception

Image fusion combines images from multiple domains into one image, containing complementary information from source domains. Existing methods take pixel intensity, texture and high-level vision task information as the standards to determine preservation of information, lacking enhancement for human perception. We introduce an image fusion method, Hierarchical Perception Fusion (HPFusion), which leverages Large Vision-Language Model to incorporate hierarchical human semantic priors, preserving complementary information that satisfies human visual system. We propose multiple questions that humans focus on when viewing an image pair, and answers are generated via the Large Vision-Language Model according to images. The texts of answers are encoded into the fusion network, and the optimization also aims to guide the human semantic distribution of the fused image more similarly to source images, exploring complementary information within the human perception domain. Extensive experiments demonstrate our HPFusoin can achieve high-quality fusion results both for information preservation and human visual enhancement.

cs.CV↗

arXiv2024

DiffFAS: Face Anti-Spoofing via Generative Diffusion Models

Face anti-spoofing (FAS) plays a vital role in preventing face recognition (FR) systems from presentation attacks. Nowadays, FAS systems face the challenge of domain shift, impacting the generalization performance of existing FAS methods. In this paper, we rethink about the inherence of domain shift and deconstruct it into two factors: image style and image quality. Quality influences the purity of the presentation of spoof information, while style affects the manner in which spoof information is presented. Based on our analysis, we propose DiffFAS framework, which quantifies quality as prior information input into the network to counter image quality shift, and performs diffusion-based high-fidelity cross-domain and cross-attack types generation to counter image style shift. DiffFAS transforms easily collectible live faces into high-fidelity attack faces with precise labels while maintaining consistency between live and spoof face identities, which can also alleviate the scarcity of labeled data with novel type attacks faced by nowadays FAS system. We demonstrate the effectiveness of our framework on challenging cross-domain and cross-attack FAS datasets, achieving the state-of-the-art performance. Available at https://github.com/murphytju/DiffFAS.

cs.CV↗

arXiv2024

SDformer: Efficient End-to-End Transformer for Depth Completion

Depth completion aims to predict dense depth maps with sparse depth measurements from a depth sensor. Currently, Convolutional Neural Network (CNN) based models are the most popular methods applied to depth completion tasks. However, despite the excellent high-end performance, they suffer from a limited representation area. To overcome the drawbacks of CNNs, a more effective and powerful method has been presented: the Transformer, which is an adaptive self-attention setting sequence-to-sequence model. While the standard Transformer quadratically increases the computational cost from the key-query dot-product of input resolution which improperly employs depth completion tasks. In this work, we propose a different window-based Transformer architecture for depth completion tasks named Sparse-to-Dense Transformer (SDformer). The network consists of an input module for the depth map and RGB image features extraction and concatenation, a U-shaped encoder-decoder Transformer for extracting deep features, and a refinement module. Specifically, we first concatenate the depth map features with the RGB image features through the input model. Then, instead of calculating self-attention with the whole feature maps, we apply different window sizes to extract the long-range depth dependencies. Finally, we refine the predicted features from the input module and the U-shaped encoder-decoder Transformer module to get the enriching depth features and employ a convolution layer to obtain the dense depth map. In practice, the SDformer obtains state-of-the-art results against the CNN-based depth completion models with lower computing loads and parameters on the NYU Depth V2 and KITTI DC datasets.

cs.CV↗

arXiv2024

AgileIR: Memory-Efficient Group Shifted Windows Attention for Agile Image Restoration

Image Transformers show a magnificent success in Image Restoration tasks. Nevertheless, most of transformer-based models are strictly bounded by exorbitant memory occupancy. Our goal is to reduce the memory consumption of Swin Transformer and at the same time speed up the model during training process. Thus, we introduce AgileIR, group shifted attention mechanism along with window attention, which sparsely simplifies the model in architecture. We propose Group Shifted Window Attention (GSWA) to decompose Shift Window Multi-head Self Attention (SW-MSA) and Window Multi-head Self Attention (W-MSA) into groups across their attention heads, contributing to shrinking memory usage in back propagation. In addition to that, we keep shifted window masking and its shifted learnable biases during training, in order to induce the model interacting across windows within the channel. We also re-allocate projection parameters to accelerate attention matrix calculation, which we found a negligible decrease in performance. As a result of experiment, compared with our baseline SwinIR and other efficient quantization models, AgileIR keeps the performance still at 32.20 dB on Set5 evaluation dataset, exceeding other methods with tailor-made efficient methods and saves over 50% memory while a large batch size is employed.

cs.CV↗

arXiv2024

Charge and spin instabilities in superconducting La$_3$Ni$_2$O$_7$

Motivated by the recent discovery of superconductivity in La$_3$Ni$_2$O$_7$ under high pressure, we explore its potential charge and spin instabilities through combined model analysis and first-principles calculations. Taking into account the small charge-transfer nature of high valence nickel, a fully correlated two-cluster model identifies a lattice-coupled charge instability characterized by substantial short-range fluctuations of oxygen holes. This instability is corroborated by density-functional-theory plus $U$ calculations that also reveal a strong tendency towards concurrent antiferromagnetic ordering. The charge, spin, and associated lattice instabilities are significantly suppressed with increasing external pressure, contributing to the emergence of superconductivity in pressurized La$_3$Ni$_2$O$_7$. Carrier doping is found to effectively suppress these instabilities, suggesting a viable strategy to stabilize a superconducting phase under ambient pressure.

cond-mat.supr-con↗

arXiv2024

Multilayer Network of Cardiovascular Diseases and Depression via Multipartite Projection

Cardiovascular diseases (CVD) and depression exhibit significant comorbidity, which is highly predictive of poor clinical outcomes. Yet, the underlying biological pathways remain challenging to decipher, presumably due to the non-linear associations across multiple mechanisms. In this study, we introduced a multipartite projection method based on mutual information correlations to construct multilayer disease networks as a novel approach to explore such intricate relationships. We applied this method to a cross-sectional dataset from a wave of the Young Finns Study, which includes data on CVD and depression, along with related risk factors and two omics of biomarkers: metabolites and lipids. Rather than directly correlating CVD-related phenotypes and depressive symptoms, we extended the notion of bipartite networks to create a multipartite network, linking these phenotypes and symptoms to intermediate biological variables. Projecting from these intermediate variables results in a weighted multilayer network, where each link between CVD and depression variables is marked by its layer (i.e., metabolome or lipidome). Applying this projection method, we identified potential mediating biomarkers that connect CVD with depression. These biomarkers may therefore play significant roles in the biological pathways underlying CVD-depression comorbidity. Additionally, the network projection highlighted sex and BMI as key risk factors, or confounders, in this comorbidity. Our method is scalable to incorporate any number of omics layers and various disease phenotypes, offering a comprehensive, system-level perspective on the biological pathways contributing to comorbidity.

cs.CE↗

arXiv2024

Spectrum Prediction With Deep 3D Pyramid Vision Transformer Learning

In this paper, we propose a deep learning (DL)-based task-driven spectrum prediction framework, named DeepSPred. The DeepSPred comprises a feature encoder and a task predictor, where the encoder extracts spectrum usage pattern features, and the predictor configures different networks according to the task requirements to predict future spectrum. Based on the Deep- SPred, we first propose a novel 3D spectrum prediction method combining a flow processing strategy with 3D vision Transformer (ViT, i.e., Swin) and a pyramid to serve possible applications such as spectrum monitoring task, named 3D-SwinSTB. 3D-SwinSTB unique 3D Patch Merging ViT-to-3D ViT Patch Expanding and pyramid designs help the model accurately learn the potential correlation of the evolution of the spectrogram over time. Then, we propose a novel spectrum occupancy rate (SOR) method by redesigning a predictor consisting exclusively of 3D convolutional and linear layers to serve possible applications such as dynamic spectrum access (DSA) task, named 3D-SwinLinear. Unlike the 3D-SwinSTB output spectrogram, 3D-SwinLinear projects the spectrogram directly as the SOR. Finally, we employ transfer learning (TL) to ensure the applicability of our two methods to diverse spectrum services. The results show that our 3D-SwinSTB outperforms recent benchmarks by more than 5%, while our 3D-SwinLinear achieves a 90% accuracy, with a performance improvement exceeding 10%.

eess.SP↗

arXiv2024

Giant Hall Switching by Surface-State-Mediated Spin-Orbit Torque in a Hard Ferromagnetic Topological Insulator

Topological insulators (TI) and magnetic topological insulators (MTI) can apply highly efficient spin-orbit torque (SOT) and manipulate the magnetization with their unique topological surface states with ultra-high efficiency. Here, we demonstrate efficient SOT switching of a hard MTI, V-doped (Bi,Sb)2Te3 (VBST) with a large coercive field that can prevent the influence of an external magnetic field. A giant switched anomalous Hall resistance of 9.2 $kΩ$ is realized, among the largest of all SOT systems, which makes the Hall channel a good readout and eliminates the need to fabricate complicated magnetic tunnel junction (MTJ) structures. The SOT switching current density can be reduced to $2.8\times10^5 A/cm^2$. Moreover, as the Fermi level is moved away from the Dirac point by both gate and composition tuning, VBST exhibits a transition from edge-state-mediated to surface-state-mediated transport, thus enhancing the SOT effective field to $1.56\pm 0.12 T/ (10^6 A/cm^2)$ and the interfacial charge-to-spin conversion efficiency to $3.9\pm 0.3 nm^{-1}$. The findings establish VBST as an extraordinary candidate for energy-efficient magnetic memory devices.

cond-mat.mes-hall↗

arXiv2024

SAM3D: Zero-Shot Semi-Automatic Segmentation in 3D Medical Images with the Segment Anything Model

We introduce SAM3D, a new approach to semi-automatic zero-shot segmentation of 3D images building on the existing Segment Anything Model. We achieve fast and accurate segmentations in 3D images with a four-step strategy involving: user prompting with 3D polylines, volume slicing along multiple axes, slice-wide inference with a pretrained model, and recomposition and refinement in 3D. We evaluated SAM3D performance qualitatively on an array of imaging modalities and anatomical structures and quantify performance for specific structures in abdominal pelvic CT and brain MRI. Notably, our method achieves good performance with zero model training or finetuning, making it particularly useful for tasks with a scarcity of preexisting labeled data. By enabling users to create 3D segmentations of unseen data quickly and with dramatically reduced manual input, these methods have the potential to aid surgical planning and education, diagnostic imaging, and scientific research.

eess.IV↗