arXiv subjects

Lei Wang

Publications and source records attributed to Lei Wang.

At least 973 records · Page 54Linked to original sources

arXiv2020

Yao.jl: Extensible, Efficient Framework for Quantum Algorithm Design

We introduce Yao, an extensible, efficient open-source framework for quantum algorithm design. Yao features generic and differentiable programming of quantum circuits. It achieves state-of-the-art performance in simulating small to intermediate-sized quantum circuits that are relevant to near-term applications. We introduce the design principles and critical techniques behind Yao. These include the quantum block intermediate representation of quantum circuits, a builtin automatic differentiation engine optimized for reversible computing, and batched quantum registers with GPU acceleration. The extensibility and efficiency of Yao help boost innovation in quantum algorithm design.

quant-ph↗

arXiv2020

Supervised Learning with Projected Entangled Pair States

Tensor networks, a model that originated from quantum physics, has been gradually generalized as efficient models in machine learning in recent years. However, in order to achieve exact contraction, only tree-like tensor networks such as the matrix product states and tree tensor networks have been considered, even for modeling two-dimensional data such as images. In this work, we construct supervised learning models for images using the projected entangled pair states (PEPS), a two-dimensional tensor network having a similar structure prior to natural images. Our approach first performs a feature map, which transforms the image data to a product state on a grid, then contracts the product state to a PEPS with trainable parameters to predict image labels. The tensor elements of PEPS are trained by minimizing differences between training labels and predicted labels. The proposed model is evaluated on image classifications using the MNIST and the Fashion-MNIST datasets. We show that our model is significantly superior to existing models using tree-like tensor networks. Moreover, using the same input features, our method performs as well as the multilayer perceptron classifier, but with much fewer parameters and is more stable. Our results shed light on potential applications of two-dimensional tensor network models in machine learning.

cs.CV↗

arXiv2020

GreyReID: A Two-stream Deep Framework with RGB-grey Information for Person Re-identification

In this paper, we observe that most false positive images (i.e., different identities with query images) in the top ranking list usually have the similar color information with the query image in person re-identification (Re-ID). Meanwhile, when we use the greyscale images generated from RGB images to conduct the person Re-ID task, some hard query images can obtain better performance compared with using RGB images. Therefore, RGB and greyscale images seem to be complementary to each other for person Re-ID. In this paper, we aim to utilize both RGB and greyscale images to improve the person Re-ID performance. To this end, we propose a novel two-stream deep neural network with RGB-grey information, which can effectively fuse RGB and greyscale feature representations to enhance the generalization ability of Re-ID. Firstly, we convert RGB images to greyscale images in each training batch. Based on these RGB and greyscale images, we train the RGB and greyscale branches, respectively. Secondly, to build up connections between RGB and greyscale branches, we merge the RGB and greyscale branches into a new joint branch. Finally, we concatenate the features of all three branches as the final feature representation for Re-ID. Moreover, in the training process, we adopt the joint learning scheme to simultaneously train each branch by the independent loss function, which can enhance the generalization ability of each branch. Besides, a global loss function is utilized to further fine-tune the final concatenated feature. The extensive experiments on multiple benchmark datasets fully show that the proposed method can outperform the state-of-the-art person Re-ID methods. Furthermore, using greyscale images can indeed improve the person Re-ID performance.

cs.CV↗

arXiv2020

Enhancing Rumor Detection in Social Media Using Dynamic Propagation Structures

Social media, such as Facebook and Twitter, has become one of the most important channels for information dissemination. However, these social media platforms are often misused to spread rumors, which has brought about severe social problems, and consequently, there are urgent needs for automatic rumor detection techniques. Existing work on rumor detection concentrates more on the utilization of textual features, but diffusion structure itself can provide critical propagating information in identifying rumors. Previous works which have considered structural information, only utilize limited propagation structures. Moreover, few related research has considered the dynamic evolution of diffusion structures. To address these issues, in this paper, we propose a Neural Model using Dynamic Propagation Structures (NM-DPS) for rumor detection in social media. Firstly, we propose a partition approach to model the dynamic evolution of propagation structure and then use temporal attention based neural model to learn a representation for the dynamic structure. Finally, we fuse the structure representation and content features into a unified framework for effective rumor detection. Experimental results on two real-world social media datasets demonstrate the salience of dynamic propagation structure information and the effectiveness of our proposed method in capturing the dynamic structure.

cs.SI↗

arXiv2020

Initial-Value Privacy of Linear Dynamical Systems

This paper studies initial-value privacy problems of linear dynamical systems. We consider a standard linear time-invariant system with random process and measurement noises. For such a system, eavesdroppers having access to system output trajectories may infer the system initial states, leading to initial-value privacy risks. When a finite number of output trajectories are eavesdropped, we consider a requirement that any guess about the initial values can be plausibly denied. When an infinite number of output trajectories are eavesdropped, we consider a requirement that the initial values should not be uniquely recoverable. In view of these two privacy requirements, we define differential initial-value privacy and intrinsic initial-value privacy, respectively, for the system as metrics of privacy risks. First of all, we prove that the intrinsic initial-value privacy is equivalent to unobservability, while the differential initial-value privacy can be achieved for a privacy budget depending on an extended observability matrix of the system and the covariance of the noises. Next, the inherent network nature of the considered linear system is explored, where each individual state corresponds to a node and the state and output matrices induce interaction and sensing graphs, leading to a network system. Under this network system perspective, we allow the initial states at some nodes to be public, and investigate the resulting intrinsic initial-value privacy of each individual node. We establish necessary and sufficient conditions for such individual node initial-value privacy, and also prove that the intrinsic initial-value privacy of individual nodes is generically determined by the network structure. These results may be extended to linear systems with time-varying dynamics under the same analysis framework.

eess.SY↗

arXiv2020

Globalized distributionally robust optimization problems under the moment-based framework

This paper is devoted to reduce the conservatism of distributionally robust optimization with moments information. Since the optimal solution of distributionally robust optimization is required to be feasible for all uncertain distributions in a given ambiguity distribution set and so the conservatism of the optimal solution is inevitable. To address this issue, we introduce the globalized distributionally robust counterpart (GDRC) which allows constraint violations controlled by functional distance of the true distribution to the inner uncertainty distribution set. We obtain the deterministic equivalent forms for several GDRCs under the moment-based framework. To be specific, we show the deterministic equivalent system of inequalities for the GDRCs under second order moment information with a separable distance function and a jointly convex distance function, respectively. Moreover, the feasible set of the system is convex. We also develop the deterministic equivalent inequality for the GDRC under first order moment and support information. The computationally tractable examples are presented for these GDRCs. A numerical tests of a portfolio optimization problem is given to show the efficiency of our methods and the results demonstrate that the globalized distributionally robust solutions is non-conservative and flexible compared to the distributionally robust solutions.

math.OC↗

arXiv2020

Shifu2: A Network Representation Learning Based Model for Advisor-advisee Relationship Mining

The advisor-advisee relationship represents direct knowledge heritage, and such relationship may not be readily available from academic libraries and search engines. This work aims to discover advisor-advisee relationships hidden behind scientific collaboration networks. For this purpose, we propose a novel model based on Network Representation Learning (NRL), namely Shifu2, which takes the collaboration network as input and the identified advisor-advisee relationship as output. In contrast to existing NRL models, Shifu2 considers not only the network structure but also the semantic information of nodes and edges. Shifu2 encodes nodes and edges into low-dimensional vectors respectively, both of which are then utilized to identify advisor-advisee relationships. Experimental results illustrate improved stability and effectiveness of the proposed model over state-of-the-art methods. In addition, we generate a large-scale academic genealogy dataset by taking advantage of Shifu2.

cs.LG↗

arXiv2020

MODEL: Motif-based Deep Feature Learning for Link Prediction

Link prediction plays an important role in network analysis and applications. Recently, approaches for link prediction have evolved from traditional similarity-based algorithms into embedding-based algorithms. However, most existing approaches fail to exploit the fact that real-world networks are different from random networks. In particular, real-world networks are known to contain motifs, natural network building blocks reflecting the underlying network-generating processes. In this paper, we propose a novel embedding algorithm that incorporates network motifs to capture higher-order structures in the network. To evaluate its effectiveness for link prediction, experiments were conducted on three types of networks: social networks, biological networks, and academic networks. The results demonstrate that our algorithm outperforms both the traditional similarity-based algorithms by 20% and the state-of-the-art embedding-based algorithms by 19%.

cs.SI↗

arXiv2020

Structure-driven intercalated architecture of septuple-atomic-layer $MA_2Z_4$ family with diverse properties from semiconductor to topological insulator to Ising superconductor

Motivated by the fact that septuple-atomic-layer MnBi$_2$Te$_4$ can be structurally viewed as the combination of double-atomic-layer MnTe intercalating into quintuple-atomic-layer Bi$_2$Te$_3$, we present a general approach of constructing twelve septuple-atomic-layer $α_i$- and $β_i$-$MA_2Z_4$ monolayer family (\emph{i} = 1 to 6) by intercalating MoS$_2$-type $MZ$$_2$ monolayer into InSe-type A$_2$Z$_2$ monolayer. Besides reproducing the experimentally synthesized $α_1$-MoSi$_2$N$_4$, $α_1$-WSi$_2$N$_4$ and $β_5$-MnBi$_2$Te$_4$ monolayer materials, another 66 thermodynamically and dynamically stable $MA_2Z_4$ were predicted, which span a wide range of properties upon the number of valence electrons (VEC). $MA_2Z_4$ with the rules of 32 or 34 VEC are mostly semiconductors with direct or indirect band gap and, however, with 33 VEC are generally metal, half-metal ferromagnetism, or spin-gapless semiconductor upon whether or not an unpaired electron is spin polarized. Moreover, we propose $α_2$-WSi$_2$P$_4$ for the spin-valley polarization, $α_1$-TaSi$_2$N$_4$ for Ising superconductor and $β_2$-SrGa$_2$Se$_4$ for topological insulator.

cond-mat.mtrl-sci↗

arXiv2020

Deep Learning based HEp-2 Image Classification: A Comprehensive Review

Classification of HEp-2 cell patterns plays a significant role in the indirect immunofluorescence test for identifying autoimmune diseases in the human body. Many automatic HEp-2 cell classification methods have been proposed in recent years, amongst which deep learning based methods have shown impressive performance. This paper provides a comprehensive review of the existing deep learning based HEp-2 cell image classification methods. These methods perform HEp-2 image classification at two levels, namely, cell-level and specimen-level. Both levels are covered in this review. At each level, the methods are organized with a deep network usage based taxonomy. The core idea, notable achievements, and key strengths and weaknesses of each method are critically analyzed. Furthermore, a concise review of the existing HEp-2 datasets that are commonly used in the literature is given. The paper ends with a discussion on novel opportunities and future research directions in this field. It is hoped that this paper would provide readers with a thorough reference of this novel, challenging, and thriving field.

cs.CV↗

arXiv2020

SABRE and the Stawell Underground Physics Laboratory: Dark Matter Research at the Australian National University

The direct detection of dark matter is a key problem in astroparticle physics that generally requires the use of deep-underground laboratories for a low-background environment where the rare signals from dark matter interactions can be observed. This work reports on the Stawell Underground Physics Laboratory - currently under construction and the first such laboratory in the Southern Hemisphere - and the associated research program. A particular focus will be given to ANU's contribution to SABRE, a NaI:Tl dark matter direct detection experiment that aims to confirm or refute the long-standing DAMA result. Preliminary measurements of the NaI:Tl quenching factor and characterisation of the SABRE liquid scintillator veto are reported.

physics.ins-det↗

arXiv2020

Residual-CycleGAN based Camera Adaptation for Robust Diabetic Retinopathy Screening

There are extensive researches focusing on automated diabetic reti-nopathy (DR) detection from fundus images. However, the accuracy drop is ob-served when applying these models in real-world DR screening, where the fun-dus camera brands are different from the ones used to capture the training im-ages. How can we train a classification model on labeled fundus images ac-quired from only one camera brand, yet still achieves good performance on im-ages taken by other brands of cameras? In this paper, we quantitatively verify the impact of fundus camera brands related domain shift on the performance of DR classification models, from an experimental perspective. Further, we pro-pose camera-oriented residual-CycleGAN to mitigate the camera brand differ-ence by domain adaptation and achieve increased classification performance on target camera images. Extensive ablation experiments on both the EyePACS da-taset and a private dataset show that the camera brand difference can signifi-cantly impact the classification performance and prove that our proposed meth-od can effectively improve the model performance on the target domain. We have inferred and labeled the camera brand for each image in the EyePACS da-taset and will publicize the camera brand labels for further research on domain adaptation.

eess.IV↗

arXiv2020

Electric-field-driven Non-volatile Multi-state Switching of Individual Skyrmions in a Multiferroic Heterostructure

Electrical manipulation of skyrmions attracts considerable attention for its rich physics and promising applications. To date, such a manipulation is realized mainly via spin-polarized current based on spin-transfer torque or spin-orbital torque effect. However, this scheme is energy-consuming and may produce massive Joule heating. To reduce energy dissipation and risk of heightened temperatures of skyrmion-based devices, an effective solution is to use electric field instead of current as stimulus. Here, we realize an electric-field manipulation of skyrmions in a nanostructured ferromagnetic/ferroelectrical heterostructure at room temperature via an inverse magneto-mechanical effect. Intriguingly, such a manipulation is non-volatile and exhibits a multi-state feature. Numerical simulations indicate that the electric-field manipulation of skyrmions originates from strain-mediated modification of effective magnetic anisotropy and Dzyaloshinskii-Moriya interaction. Our results open a direction for constructing low-energy-dissipation, non-volatile, and multi-state skyrmion-based spintronic devices.

cond-mat.mtrl-sci↗

arXiv2020

Automatic Differentiation for Second Renormalization of Tensor Networks

Tensor renormalization group (TRG) constitutes an important methodology for accurate simulations of strongly correlated lattice models. Facilitated by the automatic differentiation technique widely used in deep learning, we propose a uniform framework of differentiable TRG ($\partial$TRG) that can be applied to improve various TRG methods, in an automatic fashion. Essentially, $\partial$TRG systematically extends the concept of second renormalization [PRL 103, 160601 (2009)] where the tensor environment is computed recursively in the backward iteration, in the sense that given the forward process of TRG, $\partial$TRG automatically finds the gradient through backpropagation, with which one can deeply "train" the tensor networks. We benchmark $\partial$TRG in solving the square-lattice Ising model, and demonstrate its power by simulating one- and two-dimensional quantum systems at finite temperature. The deep optimization as well as GPU acceleration renders $\partial$TRG manybody simulations with high efficiency and accuracy.

cond-mat.str-el↗

arXiv2020

HPC AI500: The Methodology, Tools, Roofline Performance Models, and Metrics for Benchmarking HPC AI Systems

The recent years witness a trend of applying large-scale distributed deep learning in both business and scientific computing areas, whose goal is to speed up the training time to achieve a state-of-the-art quality. The HPC community feels a great interest in building the HPC AI systems that are dedicated to running those workloads. The HPC AI benchmarks accelerate the process. Unfortunately, benchmarking HPC AI systems at scale raises serious challenges. None of previous HPC AI benchmarks achieve the goal of being equivalent, relevant, representative, affordable, and repeatable. This paper presents a comprehensive methodology, tools, Roofline performance models, and innovative metrics for benchmarking, optimizing, and ranking HPC AI systems, which we call HPC AI500 V2.0. We abstract the HPC AI system into nine independent layers, and present explicit benchmarking rules and procedures to assure equivalence of each layer, repeatability, and replicability. On the basis of AIBench -- by far the most comprehensive AI benchmarks suite, we present and build two HPC AI benchmarks from both business and scientific computing: Image Classification, and Extreme Weather Analytics, achieving both representativeness and affordability. To rank the performance and energy-efficiency of HPC AI systems, we propose Valid FLOPS, and Valid FLOPS per watt, which impose a penalty on failing to achieve the target quality. We propose using convolution and GEMM -- the two most intensively-used kernel functions to measure the upper bound performance of the HPC AI systems, and present HPC AI roofline models for guiding performance optimizations. The evaluations show our methodology, benchmarks, performance models, and metrics can measure, optimize, and rank the HPC AI systems in a scalable, simple, and affordable way. HPC AI500 V2.0 are publicly available from http://www.benchcouncil.org/benchhub/hpc-ai500-benchmark.

cs.PF↗

arXiv2020

Human Activity Recognition based on Dynamic Spatio-Temporal Relations

Human activity, which usually consists of several actions, generally covers interactions among persons and or objects. In particular, human actions involve certain spatial and temporal relationships, are the components of more complicated activity, and evolve dynamically over time. Therefore, the description of a single human action and the modeling of the evolution of successive human actions are two major issues in human activity recognition. In this paper, we develop a method for human activity recognition that tackles these two issues. In the proposed method, an activity is divided into several successive actions represented by spatio temporal patterns, and the evolution of these actions are captured by a sequential model. A refined comprehensive spatio temporal graph is utilized to represent a single action, which is a qualitative representation of a human action incorporating both the spatial and temporal relations of the participant objects. Next, a discrete hidden Markov model is applied to model the evolution of action sequences. Moreover, a fully automatic partition method is proposed to divide a long-term human activity video into several human actions based on variational objects and qualitative spatial relations. Finally, a hierarchical decomposition of the human body is introduced to obtain a discriminative representation for a single action. Experimental results on the Cornell Activity Dataset demonstrate the efficiency and effectiveness of the proposed approach, which will enable long videos of human activity to be better recognized.

cs.CV↗

arXiv2020

Topological Thouless Pumping of Ultracold Fermions

A gas of electrons in a one-dimensional periodic potential can be transported even in the absence of a voltage bias if the potential is modulated slowly and periodically in time. Remarkably, the transferred charge per cycle is only sensitive to the topology of the path in parameter space. Although this so-called Thouless charge pump has first been proposed more than thirty years ago, it has not yet been realized. Here we report the first demonstration of topological Thouless pumping using ultracold atoms in a dynamically controlled optical superlattice. We observe a shift of the atomic cloud as a result of pumping and extract the topological invariance of the pumping process from this shift. We demonstrate the topological nature of the Thouless pump by varying the topology of the pumping path and verify that the topological pump indeed works in the quantum region by varying speed and temperature.

cond-mat.quant-gas↗

arXiv2020

Radiation effects on NDL prototype LGAD sensors after proton irradiation

We study the radiation effects of the Low Gain Avalanche Detector (LGAD) sensors developed by the Institute of High Energy Physics (IHEP) and the Novel Device Laboratory (NDL) of Beijing Normal University in China. These new sensors have been irradiated at the China Institute of Atomic Energy (CIAE) using 100 MeV proton beam with five different fluences from 7$\times10^{14}$ $n_{eq}/cm^2$ up to 4.5$\times10^{15}$ $n_{eq}/cm^2$. The result shows the effective doping concentration in the gain layer decreases with the increase of irradiation fluence, as expected by the acceptor removal mechanism. By comparing data and model gives the acceptor removal coefficient $c_{A}$ = $(6.07\pm0.70)\times10^{-16}~cm^2$, which indicates the NDL sensor has fairly good radiation resistance.

physics.ins-det↗