arXiv subjects

Yang Li

Publications and source records attributed to Yang Li.

At least 1,279 records · Page 71Linked to original sources

arXiv2020

Widget Captioning: Generating Natural Language Description for Mobile User Interface Elements

Natural language descriptions of user interface (UI) elements such as alternative text are crucial for accessibility and language-based interaction in general. Yet, these descriptions are constantly missing in mobile UIs. We propose widget captioning, a novel task for automatically generating language descriptions for UI elements from multimodal input including both the image and the structural representations of user interfaces. We collected a large-scale dataset for widget captioning with crowdsourcing. Our dataset contains 162,859 language phrases created by human workers for annotating 61,285 UI elements across 21,750 unique UI screens. We thoroughly analyze the dataset, and train and evaluate a set of deep model configurations to investigate how each feature modality as well as the choice of learning strategies impact the quality of predicted captions. The task formulation and the dataset as well as our benchmark models contribute a solid basis for this novel multimodal captioning task that connects language and user interfaces.

cs.LG↗

arXiv2020

A Unified Plug-and-Play Framework for Effective Data Denoising and Robust Abstention

The success of Deep Neural Networks (DNNs) highly depends on data quality. Moreover, predictive uncertainty makes high performing DNNs risky for real-world deployment. In this paper, we aim to address these two issues by proposing a unified filtering framework leveraging underlying data density, that can effectively denoise training data as well as avoid predicting uncertain test data points. Our proposed framework leverages underlying data distribution to differentiate between noise and clean data samples without requiring any modification to existing DNN architectures or loss functions. Extensive experiments on multiple image classification datasets and multiple CNN architectures demonstrate that our simple yet effective framework can outperform the state-of-the-art techniques in denoising training data and abstaining uncertain test data.

cs.LG↗

arXiv2020

A Novel Transferability Attention Neural Network Model for EEG Emotion Recognition

The existed methods for electroencephalograph (EEG) emotion recognition always train the models based on all the EEG samples indistinguishably. However, some of the source (training) samples may lead to a negative influence because they are significant dissimilar with the target (test) samples. So it is necessary to give more attention to the EEG samples with strong transferability rather than forcefully training a classification model by all the samples. Furthermore, for an EEG sample, from the aspect of neuroscience, not all the brain regions of an EEG sample contains emotional information that can transferred to the test data effectively. Even some brain region data will make strong negative effect for learning the emotional classification model. Considering these two issues, in this paper, we propose a transferable attention neural network (TANN) for EEG emotion recognition, which learns the emotional discriminative information by highlighting the transferable EEG brain regions data and samples adaptively through local and global attention mechanism. This can be implemented by measuring the outputs of multiple brain-region-level discriminators and one single sample-level discriminator. We conduct the extensive experiments on three public EEG emotional datasets. The results validate that the proposed model achieves the state-of-the-art performance.

cs.CV↗

arXiv2020

On global-in-time weak solutions to a 2D full compressible non-resistive MHD system

In this paper, we consider a two-dimensional non-resistive magnetohydrodynamic model, taking the fluctuation of absolute temperature into account. Combining the method of weak convergence developed by Lions [20], Feireisl et al. [7, 8] from compressible Navier-Stokes(- Fourier) system and the new technique of variable reduction proposed by Vasseur et al. [26] and refined by Novotny et al. [22] from compressible two-fluid models, weak solutions are shown to exist globally in time with finite energy initial data. The result is the first one on global solvability to full compressible, viscous, non-resistive magnetohydrodynamic system in multi-dimensions with large initial data.

math.AP↗

arXiv2020

Statistical Inference for Covariate-Adaptive Randomization Procedures

Covariate-adaptive randomization (CAR) procedures are frequently used in comparative studies to increase the covariate balance across treatment groups. However, because randomization inevitably uses the covariate information when forming balanced treatment groups, the validity of classical statistical methods after such randomization is often unclear. In this article, we derive the theoretical properties of statistical methods based on general CAR under the linear model framework. More importantly, we explicitly unveil the relationship between covariate-adaptive and inference properties by deriving the asymptotic representations of the corresponding estimators. We apply the proposed general theory to various randomization procedures such as complete randomization, rerandomization, pairwise sequential randomization, and Atkinson's $D_A$-biased coin design and compare their performance analytically. Based on the theoretical results, we then propose a new approach to obtain valid and more powerful tests. These results open a door to understand and analyze experiments based on CAR. Simulation studies provide further evidence of the advantages of the proposed framework and the theoretical results. Supplementary materials for this article are available online.

math.ST↗

arXiv2020

Randomness Quantification for Quantum Random Number Generation Based on Detection of Amplified Spontaneous Emission Noise

The amplified spontaneous emission (ASE) noise has been extensively studied and employed to build quantum random number generators (QRNGs). While the previous relative works mainly focus on the realization and verification of the QRNG system, the comprehensive physical model and randomness quantification for the general detection of the ASE noise are still incomplete, which is essential for the quantitative security analysis. In this paper, a systematical physical model for the emission, detection and acquisition of the ASE noise with added electronic noise is developed and verified, based on which the numerical simulations are performed under various setups and the simulation results all significantly fit well with the corresponding experimental data. Then, a randomness quantification method and the corresponding experimentally verifiable approach are proposed and validated, which quantifies the randomness purely resulted from the quantum process and improves the security analysis for the QRNG based on the detection of the ASE noise. The physical model and the randomness quantification method proposed in this paper are of significant feasibility and applicable for the QRNG system with randomness originating from the detection of the photon number with arbitrary distributions.

quant-ph↗

arXiv2020

Deep Learning Methods for Lung Cancer Segmentation in Whole-slide Histopathology Images -- the ACDC@LungHP Challenge 2019

Accurate segmentation of lung cancer in pathology slides is a critical step in improving patient care. We proposed the ACDC@LungHP (Automatic Cancer Detection and Classification in Whole-slide Lung Histopathology) challenge for evaluating different computer-aided diagnosis (CADs) methods on the automatic diagnosis of lung cancer. The ACDC@LungHP 2019 focused on segmentation (pixel-wise detection) of cancer tissue in whole slide imaging (WSI), using an annotated dataset of 150 training images and 50 test images from 200 patients. This paper reviews this challenge and summarizes the top 10 submitted methods for lung cancer segmentation. All methods were evaluated using the false positive rate, false negative rate, and DICE coefficient (DC). The DC ranged from 0.7354$\pm$0.1149 to 0.8372$\pm$0.0858. The DC of the best method was close to the inter-observer agreement (0.8398$\pm$0.0890). All methods were based on deep learning and categorized into two groups: multi-model method and single model method. In general, multi-model methods were significantly better ($\textit{p}$<$0.01$) than single model methods, with mean DC of 0.7966 and 0.7544, respectively. Deep learning based methods could potentially help pathologists find suspicious regions for further analysis of lung cancer in WSI.

eess.IV↗

arXiv2020

High-speed Gaussian modulated continuous-variable quantum key distribution with a local local oscillator based on pilot-tone-assisted phase compensation

A high-speed Gaussian modulated continuous-variable quantum key distribution (CVQKD) with a local local oscillator (LLO) is experimentally demonstrated based on pilot-tone-assisted phase compensation. In the proposed scheme, the frequency-multiplexing and polarization-multiplexing techniques are used for the separate transmission and heterodyne detection between quantum signal and pilot tone, guaranteeing no crosstalk from strong pilot tone to weak quantum signal and different detection requirements of low-noise for quantum signal and high-saturation limitation for pilot tone. Moreover, compared with the conventional CVQKD based on homodyne detection, the proposed LLO-CVQKD scheme can measure X and P quadrature simultaneously using heterodyne detection without need of extra random basis selection. Besides, the phase noise, which contains the fast-drift phase noise due to the relative phase of two independent lasers and the slow-drift phase noise introduced by quantum channel disturbance, has been compensated experimentally in real time, so that a low level of excess noise with a 25km optical fiber channel is obtained for the achievable secure key rate of 7.04 Mbps in the asymptotic regime and 1.85 Mbps under the finite-size block of 10^7.

quant-ph↗

arXiv2020

Unsupervised Deep Metric Learning with Transformed Attention Consistency and Contrastive Clustering Loss

Existing approaches for unsupervised metric learning focus on exploring self-supervision information within the input image itself. We observe that, when analyzing images, human eyes often compare images against each other instead of examining images individually. In addition, they often pay attention to certain keypoints, image regions, or objects which are discriminative between image classes but highly consistent within classes. Even if the image is being transformed, the attention pattern will be consistent. Motivated by this observation, we develop a new approach to unsupervised deep metric learning where the network is learned based on self-supervision information across images instead of within one single image. To characterize the consistent pattern of human attention during image comparisons, we introduce the idea of transformed attention consistency. It assumes that visually similar images, even undergoing different image transforms, should share the same consistent visual attention map. This consistency leads to a pairwise self-supervision loss, allowing us to learn a Siamese deep neural network to encode and compare images against their transformed or matched pairs. To further enhance the inter-class discriminative power of the feature generated by this network, we adapt the concept of triplet loss from supervised metric learning to our unsupervised case and introduce the contrastive clustering loss. Our extensive experimental results on benchmark datasets demonstrate that our proposed method outperforms current state-of-the-art methods for unsupervised metric learning by a large margin.

cs.CV↗

arXiv2020

Flow Models for Arbitrary Conditional Likelihoods

Understanding the dependencies among features of a dataset is at the core of most unsupervised learning tasks. However, a majority of generative modeling approaches are focused solely on the joint distribution $p(x)$ and utilize models where it is intractable to obtain the conditional distribution of some arbitrary subset of features $x_u$ given the rest of the observed covariates $x_o$: $p(x_u \mid x_o)$. Traditional conditional approaches provide a model for a fixed set of covariates conditioned on another fixed set of observed covariates. Instead, in this work we develop a model that is capable of yielding all conditional distributions $p(x_u \mid x_o)$ (for arbitrary $x_u$) via tractable conditional likelihoods. We propose a novel extension of (change of variables based) flow generative models, arbitrary conditioning flow models (AC-Flow), that can be conditioned on arbitrary subsets of observed covariates, which was previously infeasible. We apply AC-Flow to the imputation of features, and also develop a unified platform for both multiple and single imputation by introducing an auxiliary objective that provides a principled single "best guess" for flow models. Extensive empirical evaluations show that our models achieve state-of-the-art performance in both single and multiple imputation across image inpainting and feature imputation in synthetic and real-world datasets. Code is available at https://github.com/lupalab/ACFlow.

cs.LG↗

arXiv2020

Exchangeable Neural ODE for Set Modeling

Reasoning over an instance composed of a set of vectors, like a point cloud, requires that one accounts for intra-set dependent features among elements. However, since such instances are unordered, the elements' features should remain unchanged when the input's order is permuted. This property, permutation equivariance, is a challenging constraint for most neural architectures. While recent work has proposed global pooling and attention-based solutions, these may be limited in the way that intradependencies are captured in practice. In this work we propose a more general formulation to achieve permutation equivariance through ordinary differential equations (ODE). Our proposed module, Exchangeable Neural ODE (ExNODE), can be seamlessly applied for both discriminative and generative tasks. We also extend set modeling in the temporal dimension and propose a VAE based model for temporal set modeling. Extensive experiments demonstrate the efficacy of our method over strong baselines.

cs.LG↗

arXiv2020

Non-Hermitian Bulk-Boundary Correspondence in Periodically Driven System

Bulk-boundary correspondence, connecting the bulk topology and the edge states, is an essential principle of the topological phases. However, the bulk-boundary correspondence is broken down in general non-Hermitian systems. In this paper, we construct one-dimensional non-Hermitian Su-Schrieffer-Heeger model with periodic driving that exhibits non-Hermitian skin effect: all the eigenstates are localized at the boundary of the systems, whether the bulk states or the zero and the $π$ modes. To capture the topological properties, the non-Bloch winding numbers are defined by the non-Bloch periodized evolution operators based on the generalized Brillouin zone. Furthermore, the non-Hermitian bulk-boundary correspondence is established: the non-Bloch winding numbers ($W_{0,π}$) characterize the edge states with quasienergies $ε=0, π$. In our non-Hermitian system, a novel phenomenon can emerge that the robust edge states can appear even when the Floquet bands are topological trivial with zero non-Bloch band invariant, which is defined in terms of the non-Bloch effective Hamiltonian. We also show that the relation between the non-Bloch winding numbers ($W_{0,π}$) and the non-Bloch band invariant ($\mathcal{W}$): $\mathcal{W}= W_{0}- W_π$.

cond-mat.mes-hall↗

arXiv2020

High-Temperature Quantum Anomalous Hall Insulators in Lithium-Decorated Iron-Based Superconductor Materials

Quantum anomalous Hall (QAH) insulator is the key material to study emergent topological quantum effects, but its ultralow working temperature limits experiments. Here, by first-principles calculations, we find a family of stable two-dimensional (2D) structures generated by lithium decoration of layered iron-based superconductor materials FeX (X = S, Se, Te), and predict room-temperature ferromagnetic semiconductors together with large-gap high-Chern-number QAH insulators in the 2D materials. The extremely robust ferromagnetic order is induced by the electron injection from Li to Fe and stabilized by strong ferromagnetic kinetic exchange in the 2D Fe layer. While in the absence of spin-orbit coupling (SOC), the ferromagnetism polarizes the system into a half Dirac semimetal state protected by mirror symmetry, the SOC effect results in a spontaneous breaking of mirror symmetry and introduces a Dirac mass term, which creates QAH states with sizable gaps (several tens of meV) and multiple chiral edge modes. We also find a 3D QAH insulator phase featured by macroscopic number of chiral conduction channels in bulk LiOH-LiFeX. The findings open new opportunities to realize novel QAH physics and applications at high temperatures.

cond-mat.mtrl-sci↗

arXiv2020

A Survey on Complex Question Answering over Knowledge Base: Recent Advances and Challenges

Question Answering (QA) over Knowledge Base (KB) aims to automatically answer natural language questions via well-structured relation information between entities stored in knowledge bases. In order to make KBQA more applicable in actual scenarios, researchers have shifted their attention from simple questions to complex questions, which require more KB triples and constraint inference. In this paper, we introduce the recent advances in complex QA. Besides traditional methods relying on templates and rules, the research is categorized into a taxonomy that contains two main branches, namely Information Retrieval-based and Neural Semantic Parsing-based. After describing the methods of these branches, we analyze directions for future research and introduce the models proposed by the Alime team.

cs.CL↗

arXiv2020

Practical security analysis of a continuous-variable quantum random number generator with a noisy local oscillator

A quantum random-number generator (QRNG) can theoretically generate unpredictable random numbers with perfect devices and is an ideal and secure source of random numbers for cryptography. However, the practical implementations always contain imperfections, which will greatly influence the randomness of the final output and even open loopholes to eavesdroppers. Recently, Thewes et al. experimentally demonstrated a continuous-variable eavesdropping attack, based on heterodyne detection, on a trusted continuous-variable QRNG in Phys. Rev. A 100, 052318 (2019), yet like in many other practical continuous-variable QRNG studies, they always supposed the local oscillator was stable and ignored its fluctuation which might lead to security threats such as wavelength attack. In this work, based on the theory of the conditional min-entropy, imperfections of the practical security of continuous-variable QRNGs are systematically analyzed, especially the local oscillator fluctuation under imbalanced homodyne detection. Experiments of a practical QRNG based on vacuum fluctuation are demonstrated to show the influence of local oscillator fluctuation on the total measurement noise variances and the practical conditional min-entropy with beam splitters of different transmittances. Moreover, a local oscillator monitoring method is proposed for the practical continuous-variable QRNG, which can be used to calibrate the practical conditional min-entropy.

quant-ph↗

arXiv2020

A Novel Ensemble Deep Learning Model for Stock Prediction Based on Stock Prices and News

In recent years, machine learning and deep learning have become popular methods for financial data analysis, including financial textual data, numerical data, and graphical data. This paper proposes to use sentiment analysis to extract useful information from multiple textual data sources and a blending ensemble deep learning model to predict future stock movement. The blending ensemble model contains two levels. The first level contains two Recurrent Neural Networks (RNNs), one Long-Short Term Memory network (LSTM) and one Gated Recurrent Units network (GRU), followed by a fully connected neural network as the second level model. The RNNs, LSTM, and GRU models can effectively capture the time-series events in the input data, and the fully connected neural network is used to ensemble several individual prediction results to further improve the prediction accuracy. The purpose of this work is to explain our design philosophy and show that ensemble deep learning technologies can truly predict future stock price trends more effectively and can better assist investors in making the right investment decision than other traditional methods.

q-fin.ST↗

arXiv2020

Multi-Stage Influence Function

Multi-stage training and knowledge transfer, from a large-scale pretraining task to various finetuning tasks, have revolutionized natural language processing and computer vision resulting in state-of-the-art performance improvements. In this paper, we develop a multi-stage influence function score to track predictions from a finetuned model all the way back to the pretraining data. With this score, we can identify the pretraining examples in the pretraining task that contribute most to a prediction in the finetuning task. The proposed multi-stage influence function generalizes the original influence function for a single model in (Koh & Liang, 2017), thereby enabling influence computation through both pretrained and finetuned models. We study two different scenarios with the pretrained embeddings fixed or updated in the finetuning tasks. We test our proposed method in various experiments to show its effectiveness and potential applications.

cs.LG↗

arXiv2020

Large spin to charge conversion in topological superconductor \b{eta}-PdBi2 at room temperature

\b{eta}-PdBi2 has attracted much attention for its prospective ability to possess simultaneously topological surface and superconducting states due to its unprecedented spin-orbit interaction (SOC). Whereas most works have focused solely on investigating its topological surface states, the coupling between spin and charge degrees of freedom in this class of quantum material remains unexplored. Here we first report a study of spin-to-charge conversion in a \b{eta}-PdBi2 ultrathin film grown by molecular beam epitaxy, utilizing a spin pumping technique to perform inverse spin Hall effect measurements. We find that the room temperature spin Hall angle of Fe/\b{eta}-PdBi2, θ_SH=0.037. This value is one order of magnitude larger than that of reported conventional superconductors, and is comparable to that of the best SOC metals and topological insulators. Our results provide an avenue for developing superconductor-based spintronic applications.

cond-mat.mes-hall↗