Search arXiv⌕ Search

arXiv subjects

Yang Li

Publications and source records attributed to Yang Li.

At least 1,423 records · Page 79Linked to original sources

Disentangled Variational Auto-Encoder for Semi-supervised Learning

Semi-supervised learning is attracting increasing attention due to the fact that datasets of many domains lack enough labeled data. Variational Auto-Encoder (VAE), in particular, has demonstrated the benefits of semi-supervised learning. The majority of existing semi-supervised VAEs utilize a classifier to exploit label information, where the parameters of the classifier are introduced to the VAE. Given the limited labeled data, learning the parameters for the classifiers may not be an optimal solution for exploiting label information. Therefore, in this paper, we develop a novel approach for semi-supervised VAE without classifier. Specifically, we propose a new model called Semi-supervised Disentangled VAE (SDVAE), which encodes the input data into disentangled representation and non-interpretable representation, then the category information is directly utilized to regularize the disentangled representation via the equality constraint. To further enhance the feature learning ability of the proposed VAE, we incorporate reinforcement learning to relieve the lack of data. The dynamic framework is capable of dealing with both image and text data with its corresponding encoder and decoder networks. Extensive experiments on image and text datasets demonstrate the effectiveness of the proposed framework.

cs.LG↗

Implementation of Robust Face Recognition System Using Live Video Feed Based on CNN

The way to accurately and effectively identify people has always been an interesting topic in research and industry. With the rapid development of artificial intelligence in recent years, facial recognition gains lots of attention due to prompting the development of emerging identification methods. Compared to traditional card recognition, fingerprint recognition and iris recognition, face recognition has many advantages including non-contact interface, high concurrency, and user-friendly usage. It has high potential to be used in government, public facilities, security, e-commerce, retailing, education and many other fields. With the development of deep learning and the introduction of deep convolutional neural networks, the accuracy and speed of face recognition have made great strides. However, the results from different networks and models are very different with different system architecture. Furthermore, it could take significant amount of data storage space and data processing time for the face recognition system with video feed, if the system stores images and features of human faces. In this paper, facial features are extracted by merging and comparing multiple models, and then a deep neural network is constructed to train and construct the combined features. In this way, the advantages of multiple models can be combined to mention the recognition accuracy. After getting a model with high accuracy, we build a product model. The model will take a human face image and extract it into a vector. Then the distance between vectors are compared to determine if two faces on different picture belongs to the same person. The proposed approach reduces data storage space and data processing time for the face recognition system with video feed scientifically with our proposed system architecture.

cs.CV↗

Large time behavior for a compressible two-fluid model with algebraic pressure closure and large initial data

In this paper, we consider a compressible two-fluid system with a common velocity field and algebraic pressure closure in dimension one. Existence, uniqueness and stability of global weak solutions to this system are obtained with arbitrarily large initial data. Making use of the uniform-in-time bounds for the densities from above and below, exponential decay of weak solution to the unique steady state is obtained without any smallness restriction to the size of the initial data. In particular, our results show that degeneration to single-fluid motion will not occur as long as in the initial distribution both components are present at every point.

math.AP↗

Method for Quantitative Estimation of the Risk Propagation Threshold in Electric Power CPS Based on Seepage Probability

Because of the non-uniformity of the electric power CPS network and the dynamic nature of the risk propagation process, it is difficult to quantify the critical point of a cyber risk explosion. From the perspective of the dependency network, this paper proposes a method for quantitative evaluation of the risk propagation threshold of power CPS networks based on the percolation theory. First, the power CPS network is abstracted as a dual-layered network-directed unweighted graph according to topology correlation and coupling logic, and the asymmetrical balls-into-bins allocation method is used to establish a "one-to-many" and "partially coupled" non-uniform power CPS characterization model. Then, considering the directionality between the cyber layer and the physical layer link, the probability of percolation flow is introduced to establish the propagation dynamic equations for the internal coupling relationship of each layer. Finally, the risk propagation threshold is numerically quantified by defining the survival function of power CPS network nodes, and the validity of the proposed method is verified by the IEEE 30-bus system and 150-node Barabsi-Albert model.

physics.soc-ph↗

Robust Estimation of Similarity Transformation for Visual Object Tracking

Most of existing correlation filter-based tracking approaches only estimate simple axis-aligned bounding boxes, and very few of them is capable of recovering the underlying similarity transformation. To tackle this challenging problem, in this paper, we propose a new correlation filter-based tracker with a novel robust estimation of similarity transformation on the large displacements. In order to efficiently search in such a large 4-DoF space in real-time, we formulate the problem into two 2-DoF sub-problems and apply an efficient Block Coordinates Descent solver to optimize the estimation result. Specifically, we employ an efficient phase correlation scheme to deal with both scale and rotation changes simultaneously in log-polar coordinates. Moreover, a variant of correlation filter is used to predict the translational motion individually. Our experimental results demonstrate that the proposed tracker achieves very promising prediction performance compared with the state-of-the-art visual object tracking methods while still retaining the advantages of high efficiency and simplicity in conventional correlation filter-based tracking methods.

cs.CV↗

An amplitudes-perturbation data augmentation method in convolutional neural networks for EEG decoding

Brain-Computer Interface (BCI) system provides a pathway between humans and the outside world by analyzing brain signals which contain potential neural information. Electroencephalography (EEG) is one of most commonly used brain signals and EEG recognition is an important part of BCI system. Recently, convolutional neural networks (ConvNet) in deep learning are becoming the new cutting edge tools to tackle the problem of EEG recognition. However, training an effective deep learning model requires a big number of data, which limits the application of EEG datasets with a small number of samples. In order to solve the issue of data insufficiency in deep learning for EEG decoding, we propose a novel data augmentation method that add perturbations to amplitudes of EEG signals after transform them to frequency domain. In experiments, we explore the performance of signal recognition with the state-of-the-art models before and after data augmentation on BCI Competition IV dataset 2a and our local dataset. The results show that our data augmentation technique can improve the accuracy of EEG recognition effectively.

eess.SP↗

Heavy quarkonia production at LHC and EIC using Basis Light-Front Quantization wavefunctions

We study exclusive charmonium and bottomonium production in ultra-peripheral heavy-ion collisions and electron-ion collisions within the dipole picture. We employ heavy quarkonium light-front wavefunctions obtained within the basis light-front quantization framework, which has some features of the light-front holographic QCD. We focus on comparison with measurements of exclusive charmonium and bottomonium production in ultraperipheral $pp$, $p$Pb and PbPb collisions at LHC and find reasonable agreement with the cross sections. We also discuss the coherent production cross-section ratios of excited states to the ground state for charmonium and bottomonium, which exhibit insensitivity to the dipole model parameters. We show that electron-ion collisions provide an opportunity for a quantitative study of heavy quarkonium structure.

nucl-th↗

Learning to Screen for Fast Softmax Inference on Large Vocabulary Neural Networks

Neural language models have been widely used in various NLP tasks, including machine translation, next word prediction and conversational agents. However, it is challenging to deploy these models on mobile devices due to their slow prediction speed, where the bottleneck is to compute top candidates in the softmax layer. In this paper, we introduce a novel softmax layer approximation algorithm by exploiting the clustering structure of context vectors. Our algorithm uses a light-weight screening model to predict a much smaller set of candidate words based on the given context, and then conducts an exact softmax only within that subset. Training such a procedure end-to-end is challenging as traditional clustering methods are discrete and non-differentiable, and thus unable to be used with back-propagation in the training process. Using the Gumbel softmax, we are able to train the screening model end-to-end on the training set to exploit data distribution. The algorithm achieves an order of magnitude faster inference than the original softmax layer for predicting top-$k$ words in various tasks such as beam search in machine translation or next words prediction. For example, for machine translation task on German to English dataset with around 25K vocabulary, we can achieve 20.4 times speed up with 98.9\% precision@1 and 99.3\% precision@5 with the original softmax layer prediction, while state-of-the-art ~\citep{MSRprediction} only achieves 6.7x speedup with 98.7\% precision@1 and 98.1\% precision@5 for the same task.

cs.LG↗

$B_c$ mesons and their properties on the light front

We investigate the unequal mass relativistic bound state system, the $B_c$ mesons, in a light-front Hamiltonian formalism. We adopt an effective Hamiltonian based on soft-wall light-front holography, together with a longitudinal confinement that was first introduced for heavy quarkonium. We also include the one gluon-exchange interaction with a running coupling, which produces the spin structure. We present the mass spectrum and light-front wave functions. We also use the light-front wave functions to calculate decay constants, charge and momentum densities, as well as distribution amplitudes. The results are compared with experiments and other theoretical approaches, all of which are in reasonable agreement.

nucl-th↗

PotentialNet for Molecular Property Prediction

The arc of drug discovery entails a multiparameter optimization problem spanning vast length scales. They key parameters range from solubility (angstroms) to protein-ligand binding (nanometers) to in vivo toxicity (meters). Through feature learning---instead of feature engineering---deep neural networks promise to outperform both traditional physics-based and knowledge-based machine learning models for predicting molecular properties pertinent to drug discovery. To this end, we present the PotentialNet family of graph convolutions. These models are specifically designed for and achieve state-of-the-art performance for protein-ligand binding affinity. We further validate these deep neural networks by setting new standards of performance in several ligand-based tasks. In parallel, we introduce a new metric, the Regression Enrichment Factor $EF_χ^{(R)}$, to measure the early enrichment of computational models for chemical data. Finally, we introduce a cross-validation strategy based on structural homology clustering that can more accurately measure model generalizability, which crucially distinguishes the aims of machine learning for drug discovery from standard machine learning tasks.

cs.LG↗

A Parametric Time Frequency-Conditional Granger Causality Method Using Ultra-regularized Orthogonal Least Squares and Multiwavelets for Dynamic Connectivity Analysis in EEGs

Objective: This study proposes a new parametric TF (time frequency) CGC (conditional Granger causality) method for high precision connectivity analysis over time and frequency in multivariate coupling nonstationary systems, and applies it to scalp and source EEG signals to reveal dynamic interaction patterns in oscillatory neocortical sensorimotor networks. Methods: The Geweke spectral measure is combined with the TVARX (time varying autoregressive with exogenous input) modelling approach, which uses multiwavelets and ultra regularized orthogonal least squares (UROLS) algorithm aided by APRESS (adjustable prediction error sum of squares), to obtain high resolution time varying CGC representations. The UROLS APRESS algorithm, which adopts both the regularization technique and the ultra least squares criterion to measure not only the signal data themselves but also the weak derivatives of them, is a novel powerful method in constructing time varying models with good generalization performance, and can accurately track smooth and fast changing causalities. The generalized measurement based on CGC decomposition is able to eliminate indirect influences in multivariate systems. Results: The proposed method is validated on two simulations and then applied to multichannel motor imagery (MI) EEG signals at scalp and source level, where the predicted distributions are well recovered with high TF precision, and the detected connectivity patterns of MI EEG data are physiologically and anatomically interpretable and yield new insights into the dynamical organization of oscillatory cortical networks. Conclusion: Experimental results confirm the effectiveness of the proposed TF CGC method in tracking rapidly varying causalities of EEG based oscillatory networks. Significance: The novel TF CGC method is expected to provide important information of neural mechanisms of perception and cognition.

eess.SP↗

Axisymmetric lattice Boltzmann model for multiphase flows with large density ratio

In this paper, a novel lattice Boltzmann (LB) model based on the Allen-Cahn phase-field theory is proposed for simulating axisymmetric multiphase flows. The most striking feature of the model is that it enables to handle multiphase flows with large density ratio, which are unavailable in all previous axisymmetric LB models. The present model utilizes two LB evolution equations, one of which is used to solve fluid interface, and another is adopted to solve hydrodynamic properties. To simulate axisymmetric multiphase flows effectively, the appropriate source term and equilibrium distribution function are introduced into the LB equation for interface tracking, and simultaneously, a simple and efficient forcing distribution function is also delicately designed in the LB equation for hydrodynamic properties. Unlike many existing LB models, the source and forcing terms of the model arising from the axisymmetric effect include no additional gradients, and consequently, the present model contains only one non-local phase field variable, which in this regard is much simpler. We further conducted the Chapman-Enskog analysis to demonstrate the consistencies of our present MRT-LB model with the axisymmetric Allen-Cahn equation and hydrodynamic equations. A series of numerical examples, including static droplet, oscillation of a viscous droplet, breakup of a liquid thread, and bubble rising in a continuous phase, are used to test the performance of the proposed model. It is found that the present model can generate relatively small spurious velocities and can capture interfacial dynamics with higher accuracy than the previously improved axisymmetric LB model. Besides, it is also found that our present numerical results show excellent agreement with analytical solutions or available experimental data for a wide range of density ratios, which highlights the strengths of the proposed model.

physics.comp-ph↗

Boosted Convolutional Neural Networks for Motor Imagery EEG Decoding with Multiwavelet-based Time-Frequency Conditional Granger Causality Analysis

Decoding EEG signals of different mental states is a challenging task for brain-computer interfaces (BCIs) due to nonstationarity of perceptual decision processes. This paper presents a novel boosted convolutional neural networks (ConvNets) decoding scheme for motor imagery (MI) EEG signals assisted by the multiwavelet-based time-frequency (TF) causality analysis. Specifically, multiwavelet basis functions are first combined with Geweke spectral measure to obtain high-resolution TF-conditional Granger causality (CGC) representations, where a regularized orthogonal forward regression (ROFR) algorithm is adopted to detect a parsimonious model with good generalization performance. The causality images for network input preserving time, frequency and location information of connectivity are then designed based on the TF-CGC distributions of alpha band multichannel EEG signals. Further constructed boosted ConvNets by using spatio-temporal convolutions as well as advances in deep learning including cropping and boosting methods, to extract discriminative causality features and classify MI tasks. Our proposed approach outperforms the competition winner algorithm with 12.15% increase in average accuracy and 74.02% decrease in associated inter subject standard deviation for the same binary classification on BCI competition-IV dataset-IIa. Experiment results indicate that the boosted ConvNets with causality images works well in decoding MI-EEG signals and provides a promising framework for developing MI-BCI systems.

cs.CV↗

Isotropic non-local Gilbert damping driven by spin currents in epitaxial Pd/Fe/MgO(001) films

Although both theoretical predications and experimental observations demonstrated that the damping factor is anisotropic at ferromagnet/semiconductor interface with robust interfacial spin-orbit coupling, it is not well understood whether non-local Gilbert damping driven by spin currents in heavy metal/ferromagnetic metal (HM/FM) bilayers is anisotropic or not. Here, we investigated the in-plane angular- and frequency- dependence of magnetic relaxation of epitaxial Fe/MgO(001) films with different capping layers of Pd and Cu. After disentangling the parasitic contributions, such as two-magnon scattering (TMS), mosaicity, and field-dragging effect, we unambiguously observed that both local and non-local Gilbert damping are isotropic in Fe(001) plane, suggesting that the pure spin currents absorption is independent of Fe magnetization orientation in the epitaxial Pd/Fe heterostructure. First principles calculation reveals that the effective spin mixing conductance of Pd/Fe interface is nearly invariant for different magnetization directions in good agreement with the experimental observations. These results offer a valuable insight into the transmission and absorption of pure spin currents, and facilitate us to utilize next-generation spintronic devices.

cond-mat.mtrl-sci↗

Optimized Extreme Learning Machine for Power System Transient Stability Prediction Using Synchrophasors

A new optimized extreme learning machine- (ELM-) based method for power system transient stability prediction (TSP) using synchrophasors is presented in this paper. First, the input features symbolizing the transient stability of power systems are extracted from synchronized measurements. Then, an ELM classifier is employed to build the TSP model. And finally, the optimal parameters of the model are optimized by using the improved particle swarm optimization (IPSO) algorithm. The novelty of the proposal is in the fact that it improves the prediction performance of the ELM-based TSP model by using IPSO to optimize the parameters of the model with synchrophasors. And finally, based on the test results on both IEEE 39-bus system and a large-scale real power system, the correctness and validity of the presented approach are verified.

cs.NE↗

Optimal scheduling of isolated microgrid with an electric vehicle battery swapping station in multi-stakeholder scenarios: a bi-level programming approach via real-time pricing

In order to coordinate the scheduling problem between an isolated microgrid (IMG) and electric vehicle battery swapping stations (BSSs) in multi-stakeholder scenarios, a new bi-level optimal scheduling model is proposed for promoting the participation of BSSs in regulating the IMG economic operation. In this model, the upper-level sub-problem is formulated to minimize the IMG net costs, while the lower-level aims to maximize the profits of the BSS under real-time pricing environments determined by demand responses in the upper-level decision. To solve the model, a hybrid algorithm, called JAYA-BBA, is put forward by combining a real/integer-coded JAYA algorithm and the branch and bound algorithm (BBA), in which the JAYA and BBA are respectively employed to address the upper- and lower- level sub-problems, and the bi-level model is eventually solved through alternate iterations between the two levels. The simulation results on a microgrid test system verify the effectiveness and superiority of the presented approach.

eess.SP↗

Form Factors and Generalized Parton Distributions of Heavy Quarkonia in Basis Light Front Quantization

We calculate the electromagnetic (charge, magnetic and quadrupole) form factors and the associated static moments of heavy quarkonia (charmonia and bottomonia) using the Basis Light Front Quantization (BLFQ) approach. For this work, we adopt light front wavefunctions (LFWFs) generated by a holographic QCD confining potential and a one-gluon exchange interaction with fixed coupling. We compare our BLFQ results with the limiting case of a single BLFQ basis state description of heavy quarkonia and with other available results. These comparisons provide insights into relativistic effects. Using the same LFWFs generated in the BLFQ approach, we also present the generalized parton distributions (GPDs) for selected mesons including those for radially excited mesons such as $ψ^\prime$ and $Υ^\prime$. Our GPD results establish the foundation within BLFQ for further investigating hadronic structure such as probing the spin structure of spin-one hadrons in the off-forward limit.

hep-ph↗