arXiv subjects

Yan Liu

Publications and source records attributed to Yan Liu.

At least 433 records · Page 24Linked to original sources

arXiv2019

Adaptive Gradient Methods with Dynamic Bound of Learning Rate

Adaptive optimization methods such as AdaGrad, RMSprop and Adam have been proposed to achieve a rapid training process with an element-wise scaling term on learning rates. Though prevailing, they are observed to generalize poorly compared with SGD or even fail to converge due to unstable and extreme learning rates. Recent work has put forward some algorithms such as AMSGrad to tackle this issue but they failed to achieve considerable improvement over existing methods. In our paper, we demonstrate that extreme learning rates can lead to poor performance. We provide new variants of Adam and AMSGrad, called AdaBound and AMSBound respectively, which employ dynamic bounds on learning rates to achieve a gradual and smooth transition from adaptive methods to SGD and give a theoretical proof of convergence. We further conduct experiments on various popular tasks and models, which is often insufficient in previous work. Experimental results show that new variants can eliminate the generalization gap between adaptive methods and SGD and maintain higher learning speed early in training at the same time. Moreover, they can bring significant improvement over their prototypes, especially on complex deep networks. The implementation of the algorithm can be found at https://github.com/Luolc/AdaBound .

cs.LG↗

arXiv2019

Differentiable Physics-informed Graph Networks

While physics conveys knowledge of nature built from an interplay between observations and theory, it has been considered less importantly in deep neural networks. Especially, there are few works leveraging physics behaviors when the knowledge is given less explicitly. In this work, we propose a novel architecture called Differentiable Physics-informed Graph Networks (DPGN) to incorporate implicit physics knowledge which is given from domain experts by informing it in latent space. Using the concept of DPGN, we demonstrate that climate prediction tasks are significantly improved. Besides the experiment results, we validate the effectiveness of the proposed module and provide further applications of DPGN, such as inductive learning and multistep predictions.

cs.LG↗

arXiv2019

Combating Fake News: A Survey on Identification and Mitigation Techniques

The proliferation of fake news on social media has opened up new directions of research for timely identification and containment of fake news, and mitigation of its widespread impact on public opinion. While much of the earlier research was focused on identification of fake news based on its contents or by exploiting users' engagements with the news on social media, there has been a rising interest in proactive intervention strategies to counter the spread of misinformation and its impact on society. In this survey, we describe the modern-day problem of fake news and, in particular, highlight the technical challenges associated with it. We discuss existing methods and techniques applicable to both identification and mitigation, with a focus on the significant advances in each method and their advantages and limitations. In addition, research has often been limited by the quality of existing datasets and their specific application contexts. To alleviate this problem, we comprehensively compile and summarize characteristic features of available datasets. Furthermore, we outline new directions of research to facilitate future development of effective and interdisciplinary solutions.

cs.LG↗

arXiv2018

Topological invariants for holographic semimetals

We study the behavior of fermion spectral functions for the holographic topological Weyl and nodal line semimetals. We calculate the topological invariants from the Green functions of both holographic semimetals using the topological Hamiltonian method, which calculates topological invariants of strongly interacting systems from an effective Hamiltonian system with the same topological structure. Nontrivial topological invariants for both systems have been obtained and the presence of nontrivial topological invariants further supports the topological nature of the holographic semimetals.

hep-th↗

arXiv2018

Topological nodal line semimetals in holography

We show a holographic model of a strongly coupled topological nodal line semimetal (NLSM) and find that the NLSM phase could go through a quantum phase transition to a topologically trivial state. The dual fermion spectral function shows that there are multiple Fermi surfaces each of which is a closed nodal loop in the NLSM phase. The topological structure in the bulk is induced by the IR interplay between the dual mass operator and the operator that deforms the topology of the Fermi surface. We propose a practical framework for building various strongly coupled topological semimetals in holography, which indicates that at strong coupling topologically nontrivial semimetal states generally exist.

hep-th↗

arXiv2018

Can I trust you more? Model-Agnostic Hierarchical Explanations

Interactions such as double negation in sentences and scene interactions in images are common forms of complex dependencies captured by state-of-the-art machine learning models. We propose Mahé, a novel approach to provide Model-agnostic hierarchical éxplanations of how powerful machine learning models, such as deep neural networks, capture these interactions as either dependent on or free of the context of data instances. Specifically, Mahé provides context-dependent explanations by a novel local interpretation algorithm that effectively captures any-order interactions, and obtains context-free explanations through generalizing context-dependent interactions to explain global behaviors. Experimental results show that Mahé obtains improved local interaction interpretations over state-of-the-art methods and successfully explains interactions that are context-free.

stat.ML↗

arXiv2018

Trace class perturbation of closed linear relations

This paper studies trace class perturbation of closed linear relations in Hilbert spaces. The concept of trace class perturbation of closed relations is introduced by orthogonal projections. Equivalent characterizations of compact and trace class block operator matrices are first given in terms of their elements, separately. By using them, several equivalent and sufficient characterizations of trace class perturbation of closed linear relations are obtained.

math.SP↗

arXiv2018

Single SiV$^-$ centers in low-strain nanodiamonds with bulk-like spectral properties and nano-manipulation capabilities

We report on the isolation of single SiV$^-$ centers in nanodiamonds. We observe the fine-structure of single SiV$^-$ center with improved inhomogeneous ensemble linewidth below the excited state splitting, stable optical transitions, good polarization contrast and excellent spectral stability under resonant excitation. Based on our experimental results we elaborate an analytical strain model where we extract the ratio between strain coefficients of excited and ground states as well the intrinsic zero-strain spin-orbit splittings. The observed strain values are as low as best values in low-strain bulk diamond. We achieve our results by means of H-plasma treatment of the diamond surface and in combination with resonant and off-resonant excitation. Our work paves the way for indistinguishable, single photon emission. Furthermore, we demonstrate controlled nano-manipulation via atomic force microscope cantilever of 1D- and 2D-alignments with a so-far unreached accuracy of about 10nm, as well as new tools including dipole rotation and cluster decomposition. Combined, our results show the potential to utilize SiV$^-$ centers in nanodiamonds for the controlled interfacing via optical coupling of individually well-isolated atoms for bottom-up assemblies of complex quantum systems.

cond-mat.mes-hall↗

arXiv2018

Dial2Desc: End-to-end Dialogue Description Generation

We first propose a new task named Dialogue Description (Dial2Desc). Unlike other existing dialogue summarization tasks such as meeting summarization, we do not maintain the natural flow of a conversation but describe an object or an action of what people are talking about. The Dial2Desc system takes a dialogue text as input, then outputs a concise description of the object or the action involved in this conversation. After reading this short description, one can quickly extract the main topic of a conversation and build a clear picture in his mind, without reading or listening to the whole conversation. Based on the existing dialogue dataset, we build a new dataset, which has more than one hundred thousand dialogue-description pairs. As a step forward, we demonstrate that one can get more accurate and descriptive results using a new neural attentive model that exploits the interaction between utterances from different speakers, compared with other baselines.

cs.CL↗

arXiv2018

Skeleton-based Activity Recognition with Local Order Preserving Match of Linear Patches

Human activity recognition has drawn considerable attention recently in the field of computer vision due to the development of commodity depth cameras, by which the human activity is represented as a sequence of 3D skeleton postures. Assuming human body 3D joint locations of an activity lie on a manifold, the problem of recognizing human activity is formulated as the computation of activity manifold-manifold distance (AMMD). In this paper, we first design an efficient division method to decompose a manifold into ordered continuous maximal linear patches (CMLPs) that denote meaningful action snippets of the action sequence. Then the CMLP is represented by its position (average value of points) and the first principal component, which specify the major posture and main evolving direction of an action snippet, respectively. Finally, we compute the distance between CMLPs by taking both the posture and direction into consideration. Based on these preparations, an intuitive distance measure that preserves the local order of action snippets is proposed to compute AMMD. The performance on two benchmark datasets demonstrates the effectiveness of the proposed approach.

cs.CV↗

arXiv2018

An application of $L^m-L^r$ estimates to weakly coupled systems of semilinear viscoelastic wave equations

We consider weakly coupled systems of semilinear viscoelastic wave equations with different power source nonlinearities in $\mathbb{R}^n$, $n\geq1$ as follows: \begin{equation*} \left\{\begin{aligned} &u_{tt}-Δu+g\astΔu+u_t=|\partial_t^{\ell}v|^p,\\ &v_{tt}-Δv+g\astΔv+v_t=|\partial_t^{\ell}u|^q,\\ \end{aligned}\right. \end{equation*} with $\ell=0,1$ and $p,q>1$. After presenting $L^m-L^r$ estimates with $1\leq m\leq r\leq \infty$ of solutions to the corresponding linearized problem with vanishing right-hand side, we prove the existence of global in time solutions to the weakly coupled systems, where the initial data are supposed to belong to different $L^r$ spaces with different additional $L^m$ regularities.

math.AP↗

arXiv2018

Weyl semimetal/insulator transition from holography

We study a holographic model which exhibits a quantum phase transition from the strongly interacting Weyl semimetal phase to an insulating phase. In the holographic insulating phase there is a hard gap in the real part of frequency dependent diagonal conductivities. However, the anomalous Hall conductivity is nonzero at zero frequency, indicting that it is a Chern insulator. This holographic quantum phase transition is always of first order, signified by a discontinuous anomalous Hall conductivity at the phase transition, in contrast to the very continuous holographic Weyl semimetal/trivial semimetal phase transition. Our work reveals the novel phase structure of strongly interacting Weyl semimetal.

hep-th↗

arXiv2018

Building a Controlled Vocabulary for Standardizing Precision Medicine Terms

Rapid advances of technology and development of research in precision medicine domain have led to the production of different types of biomedical data. Standard medical vocabularies were shown to be limited in dealing with such heterogeneous data and consequently, new controlled vocabulary for data integration and normalization has been proposed. In this study, the precision medicine vocabulary (PMV), which is a controlled vocabulary for terms used in precision medicine, is built based on the method of data integration in Unified Medical Language System (UMLS). It now covers ten top semantic types of disease, drug, gene, gene variation and so on. In total of 1,372,967 concepts and 4,567,208 terms have been integrated from widely used databases related with precision medicine.

cs.CY↗

arXiv2018

DynGEM: Deep Embedding Method for Dynamic Graphs

Embedding large graphs in low dimensional spaces has recently attracted significant interest due to its wide applications such as graph visualization, link prediction and node classification. Existing methods focus on computing the embedding for static graphs. However, many graphs in practical applications are dynamic and evolve constantly over time. Naively applying existing embedding algorithms to each snapshot of dynamic graphs independently usually leads to unsatisfactory performance in terms of stability, flexibility and efficiency. In this work, we present an efficient algorithm DynGEM based on recent advances in deep autoencoders for graph embeddings, to address this problem. The major advantages of DynGEM include: (1) the embedding is stable over time, (2) it can handle growing dynamic graphs, and (3) it has better running time than using static embedding methods on each snapshot of a dynamic graph. We test DynGEM on a variety of tasks including graph visualization, graph reconstruction, link prediction and anomaly detection (on both synthetic and real datasets). Experimental results demonstrate the superior stability and scalability of our approach.

cs.SI↗

arXiv2018

Feature Selection of Post-Graduation Income of College Students in the United States

This study investigated the most important attributes of the 6-year post-graduation income of college graduates who used financial aid during their time at college in the United States. The latest data released by the United States Department of Education was used. Specifically, 1,429 cohorts of graduates from three years (2001, 2003, and 2005) were included in the data analysis. Three attribute selection methods, including filter methods, forward selection, and Genetic Algorithm, were applied to the attribute selection from 30 relevant attributes. Five groups of machine learning algorithms were applied to the dataset for classification using the best selected attribute subsets. Based on our findings, we discuss the role of neighborhood professional degree attainment, parental income, SAT scores, and family college education in post-graduation incomes and the implications for social stratification.

cs.CY↗

arXiv2018

Deep Generative Dual Memory Network for Continual Learning

Despite advances in deep learning, neural networks can only learn multiple tasks when trained on them jointly. When tasks arrive sequentially, they lose performance on previously learnt tasks. This phenomenon called catastrophic forgetting is a fundamental challenge to overcome before neural networks can learn continually from incoming data. In this work, we derive inspiration from human memory to develop an architecture capable of learning continuously from sequentially incoming tasks, while averting catastrophic forgetting. Specifically, our contributions are: (i) a dual memory architecture emulating the complementary learning systems (hippocampus and the neocortex) in the human brain, (ii) memory consolidation via generative replay of past experiences, (iii) demonstrating advantages of generative replay and dual memories via experiments, and (iv) improved performance retention on challenging tasks even for low capacity models. Our architecture displays many characteristics of the mammalian memory and provides insights on the connection between sleep and learning.

cs.LG↗

arXiv2018

Anomalous transport model with axial magnetic fields

The transport properties of massless fermions in $3+1$ spacetime dimension have been in the focus of recent theoretical and experimental research. New transport properties appear as consequences of chiral anomalies. The most prominent is the generation of a current in a magnetic field, the so-called chiral magnetic effect leading to an enhancement of the electric conductivity (negative magnetoresistivity). We study the analogous effect for axial magnetic fields that couple with opposite signs to fermions of different chirality. We emphasize local charge conservation and study the induced magneto-conductivities proportional to an electric field and a gradient in temperature. We find that the magnetoconductivity is enhanced whereas the magneto-thermoelectric conductivity is diminished. As a side result we interpret an anomalous contribution to the entropy current as a generalized thermal Hall effect.

cond-mat.mes-hall↗

arXiv2018

Detecting Statistical Interactions from Neural Network Weights

Interpreting neural networks is a crucial and challenging task in machine learning. In this paper, we develop a novel framework for detecting statistical interactions captured by a feedforward multilayer neural network by directly interpreting its learned weights. Depending on the desired interactions, our method can achieve significantly better or similar interaction detection performance compared to the state-of-the-art without searching an exponential solution space of possible interactions. We obtain this accuracy and efficiency by observing that interactions between input features are created by the non-additive effect of nonlinear activation functions, and that interacting paths are encoded in weight matrices. We demonstrate the performance of our method and the importance of discovered interactions via experimental results on both synthetic datasets and real-world application datasets.

stat.ML↗