Search arXiv⌕ Search

arXiv subjects

Lei Wang

Publications and source records attributed to Lei Wang.

At least 901 records · Page 50Linked to original sources
arXiv2021

Large-Scale Secure XGB for Vertical Federated Learning

Privacy-preserving machine learning has drawn increasingly attention recently, especially with kinds of privacy regulations come into force. Under such situation, Federated Learning (FL) appears to facilitate privacy-preserving joint modeling among multiple parties. Although many federated algorithms have been extensively studied, there is still a lack of secure and practical gradient tree boosting models (e.g., XGB) in literature. In this paper, we aim to build large-scale secure XGB under vertically federated learning setting. We guarantee data privacy from three aspects. Specifically, (i) we employ secure multi-party computation techniques to avoid leaking intermediate information during training, (ii) we store the output model in a distributed manner in order to minimize information release, and (iii) we provide a novel algorithm for secure XGB predict with the distributed model. Furthermore, by proposing secure permutation protocols, we can improve the training efficiency and make the framework scale to large dataset. We conduct extensive experiments on both public datasets and real-world datasets, and the results demonstrate that our proposed XGB models provide not only competitive accuracy but also practical performance.

cs.LG↗
arXiv2021

Ultrahigh-Efficiency Second Harmonic Generation in a Reverse-Polarization Dual-Layer Crystalline Thin Film Nanophotonic Waveguide

Second harmonic generation (SHG), as one of the most significant \c{hi}(2) nonlinear optical processes, plays crucial roles in a broad variety of optical and photonic applications. Designing various delicate schemes to achieve highly efficient SHG has become a long standing and challenging topic in field of nonlinear optics. Despite numerous success on SHG based on birefringent phase matching and quasi-phase matching, so far, modal phase matching (MPM) for SHG in tightly light-confined structures has still in its infancy. Here, we propose a new scheme to realize highly-efficient SHG via MPM by using a nanophotonic LiNbO3 thin-film waveguide consists of two bonded layers with internally reversed polarizations. In such a dual-layer ridge waveguide based on lithium niobate on insulator, upon optical excitation at 1574.6 nm, we observe SHG at 787.3 nm with ultrahigh conversion efficiency of 5,540% /W/cm/cm experimentally. This work advances our understanding on modal-phase-matched SHG and other quadratic optical nonlinear process, offering additional strategies for development of high-performance nonlinear photonic devices in on-chip platforms.

physics.optics↗
arXiv2021

Tensor Representations for Action Recognition

Human actions in video sequences are characterized by the complex interplay between spatial features and their temporal dynamics. In this paper, we propose novel tensor representations for compactly capturing such higher-order relationships between visual features for the task of action recognition. We propose two tensor-based feature representations, viz. (i) sequence compatibility kernel (SCK) and (ii) dynamics compatibility kernel (DCK). SCK builds on the spatio-temporal correlations between features, whereas DCK explicitly models the action dynamics of a sequence. We also explore generalization of SCK, coined SCK(+), that operates on subsequences to capture the local-global interplay of correlations, which can incorporate multi-modal inputs e.g., skeleton 3D body-joints and per-frame classifier scores obtained from deep learning models trained on videos. We introduce linearization of these kernels that lead to compact and fast descriptors. We provide experiments on (i) 3D skeleton action sequences, (ii) fine-grained video sequences, and (iii) standard non-fine-grained videos. As our final representations are tensors that capture higher-order relationships of features, they relate to co-occurrences for robust fine-grained recognition. We use higher-order tensors and so-called Eigenvalue Power Normalization (EPN) which have been long speculated to perform spectral detection of higher-order occurrences, thus detecting fine-grained relationships of features rather than merely count features in action sequences. We prove that a tensor of order r, built from Z* dimensional features, coupled with EPN indeed detects if at least one higher-order occurrence is `projected' into one of its binom(Z*,r) subspaces of dim. r represented by the tensor, thus forming a Tensor Power Normalization metric endowed with binom(Z*,r) such `detectors'.

cs.CV↗
arXiv2021

Observability is Sufficient for the Design of Globally Exponentially Convergent State Observers for State-affine Nonlinear Systems

In this paper we are interested in the problem of state observation of state-affine nonlinear systems. Our main contribution is to propose a globally exponentially convergent observer that requires only the necessary assumption of observability of the system. To the best of the authors' knowledge this is the first time such a result is reported in the literature.

eess.SY↗
arXiv2021

Identifiability Implies Robust, Globally Exponentially Convergent On-line Parameter Estimation: Application to Model Reference Adaptive Control

In this paper we propose a new parameter estimator that ensures global exponential convergence of linear regression models requiring only the necessary assumption of identifiability of the regression equation,which we show is equivalent to interval excitation of the regressor vector. Continuous and discrete-time versions of the estimators are given. An extension to--separable and monotonic--non-linear parameterizations is also given. The estimators are shown to be robust to additive measurement noise and--not necessarily slow--parameter variations. Moreover, a version of the continuous-time estimator that rejects sinusoidal disturbances with unknown internal model is given. The estimator is shown to be applicable to the classical model reference adaptive control problem relaxing the conspicuous assumption of known sign of the high-frequency gain. Simulation results that illustrate the performance of the estimator are given.

eess.SY↗
arXiv2021

Cascade Bagging for Accuracy Prediction with Few Training Samples

Accuracy predictor is trained to predict the validation accuracy of an network from its architecture encoding. It can effectively assist in designing networks and improving Neural Architecture Search(NAS) efficiency. However, a high-performance predictor depends on adequate trainning samples, which requires unaffordable computation overhead. To alleviate this problem, we propose a novel framework to train an accuracy predictor under few training samples. The framework consists ofdata augmentation methods and an ensemble learning algorithm. The data augmentation methods calibrate weak labels and inject noise to feature space. The ensemble learning algorithm, termed cascade bagging, trains two-level models by sampling data and features. In the end, the advantages of above methods are proved in the Performance Prediciton Track of CVPR2021 1st Lightweight NAS Challenge. Our code is made public at: https://github.com/dlongry/Solutionto-CVPR2021-NAS-Track2.

cs.CV↗
arXiv2021

Improving Ranking Correlation of Supernet with Candidates Enhancement and Progressive Training

One-shot neural architecture search (NAS) applies weight-sharing supernet to reduce the unaffordable computation overhead of automated architecture designing. However, the weight-sharing technique worsens the ranking consistency of performance due to the interferences between different candidate networks. To address this issue, we propose a candidates enhancement method and progressive training pipeline to improve the ranking correlation of supernet. Specifically, we carefully redesign the sub-networks in the supernet and map the original supernet to a new one of high capacity. In addition, we gradually add narrow branches of supernet to reduce the degree of weight sharing which effectively alleviates the mutual interference between sub-networks. Finally, our method ranks the 1st place in the Supernet Track of CVPR2021 1st Lightweight NAS Challenge.

cs.CV↗
arXiv2021

Novel Two-Dimensional Layered MSi$_2$N$_4$ (M = Mo, W): New Promising Thermal Management Materials

With the miniaturization and integration of nanoelectronic devices, efficient heat removal becomes a key factor affecting the reliable operation of the nanoelectronic device. With the high intrinsic thermal conductivity, good mechanical flexibility, and precisely controlled growth, two-dimensional (2D) materials are widely accepted as ideal candidates for thermal management materials. In this work, by solving the phonon Boltzmann transport equation (BTE) based on first-principles calculations, we comprehensively investigated the thermal conductivity of novel 2D layered MSi$_2$N$_4$ (M = Mo, W). Our results point to competitive thermal conductivities (162 W/mK) of monolayer MoSi$_2$N$_4$, which is around two times larger than that of WSi$_2$N$_4$ and seven times larger than that of silicene despite their similar non-planar structures. It is revealed that the high thermal conductivity arises mainly from its large group velocity and low anharmonicity. Our result suggests that MoSi$_2$N$_4$ could be a potential candidate for 2D thermal management materials.

cond-mat.mtrl-sci↗
arXiv2021

Few-shot Unsupervised Domain Adaptation with Image-to-class Sparse Similarity Encoding

This paper investigates a valuable setting called few-shot unsupervised domain adaptation (FS-UDA), which has not been sufficiently studied in the literature. In this setting, the source domain data are labelled, but with few-shot per category, while the target domain data are unlabelled. To address the FS-UDA setting, we develop a general UDA model to solve the following two key issues: the few-shot labeled data per category and the domain adaptation between support and query sets. Our model is general in that once trained it will be able to be applied to various FS-UDA tasks from the same source and target domains. Inspired by the recent local descriptor based few-shot learning (FSL), our general UDA model is fully built upon local descriptors (LDs) for image classification and domain adaptation. By proposing a novel concept called similarity patterns (SPs), our model not only effectively considers the spatial relationship of LDs that was ignored in previous FSL methods, but also makes the learned image similarity better serve the required domain alignment. Specifically, we propose a novel IMage-to-class sparse Similarity Encoding (IMSE) method. It learns SPs to extract the local discriminative information for classification and meanwhile aligns the covariance matrix of the SPs for domain adaptation. Also, domain adversarial training and multi-scale local feature matching are performed upon LDs. Extensive experiments conducted on a multi-domain benchmark dataset DomainNet demonstrates the state-of-the-art performance of our IMSE for the novel setting of FS-UDA. In addition, for FSL, our IMSE can also show better performance than most of recent FSL methods on miniImageNet.

cs.CV↗
arXiv2021

Self-supervising Action Recognition by Statistical Moment and Subspace Descriptors

In this paper, we build on a concept of self-supervision by taking RGB frames as input to learn to predict both action concepts and auxiliary descriptors e.g., object descriptors. So-called hallucination streams are trained to predict auxiliary cues, simultaneously fed into classification layers, and then hallucinated at the testing stage to aid network. We design and hallucinate two descriptors, one leveraging four popular object detectors applied to training videos, and the other leveraging image- and video-level saliency detectors. The first descriptor encodes the detector- and ImageNet-wise class prediction scores, confidence scores, and spatial locations of bounding boxes and frame indexes to capture the spatio-temporal distribution of features per video. Another descriptor encodes spatio-angular gradient distributions of saliency maps and intensity patterns. Inspired by the characteristic function of the probability distribution, we capture four statistical moments on the above intermediate descriptors. As numbers of coefficients in the mean, covariance, coskewness and cokurtotsis grow linearly, quadratically, cubically and quartically w.r.t. the dimension of feature vectors, we describe the covariance matrix by its leading n' eigenvectors (so-called subspace) and we capture skewness/kurtosis rather than costly coskewness/cokurtosis. We obtain state of the art on five popular datasets such as Charades and EPIC-Kitchens.

cs.CV↗
arXiv2021

Factorizations of almost simple unitary groups

This is the second one in a series of papers classifying the factorizations of almost simple groups with nonsolvable factors. In this paper we deal with almost simple unitary groups.

math.GR↗
arXiv2021

Hand Image Understanding via Deep Multi-Task Learning

Analyzing and understanding hand information from multimedia materials like images or videos is important for many real world applications and remains active in research community. There are various works focusing on recovering hand information from single image, however, they usually solve a single task, for example, hand mask segmentation, 2D/3D hand pose estimation, or hand mesh reconstruction and perform not well in challenging scenarios. To further improve the performance of these tasks, we propose a novel Hand Image Understanding (HIU) framework to extract comprehensive information of the hand object from a single RGB image, by jointly considering the relationships between these tasks. To achieve this goal, a cascaded multi-task learning (MTL) backbone is designed to estimate the 2D heat maps, to learn the segmentation mask, and to generate the intermediate 3D information encoding, followed by a coarse-to-fine learning paradigm and a self-supervised learning strategy. Qualitative experiments demonstrate that our approach is capable of recovering reasonable mesh representations even in challenging situations. Quantitatively, our method significantly outperforms the state-of-the-art approaches on various widely-used datasets, in terms of diverse evaluation metrics.

cs.CV↗
arXiv2021

Crosslink-Net: Double-branch Encoder Segmentation Network via Fusing Vertical and Horizontal Convolutions

Accurate image segmentation plays a crucial role in medical image analysis, yet it faces great challenges of various shapes, diverse sizes, and blurry boundaries. To address these difficulties, square kernel-based encoder-decoder architecture has been proposed and widely used, but its performance remains still unsatisfactory. To further cope with these challenges, we present a novel double-branch encoder architecture. Our architecture is inspired by two observations: 1) Since the discrimination of features learned via square convolutional kernels needs to be further improved, we propose to utilize non-square vertical and horizontal convolutional kernels in the double-branch encoder, so features learned by the two branches can be expected to complement each other. 2) Considering that spatial attention can help models to better focus on the target region in a large-sized image, we develop an attention loss to further emphasize the segmentation on small-sized targets. Together, the above two schemes give rise to a novel double-branch encoder segmentation framework for medical image segmentation, namely Crosslink-Net. The experiments validate the effectiveness of our model on four datasets. The code is released at https://github.com/Qianyu1226/Crosslink-Net.

eess.IV↗
arXiv2021

Measurement of the relative Quantum Efficiency of Hamamatsu model R5912-20MOD photomultiplier tubes at liquid argon temperature

The model R5912-20MOD photomultiplier tube(PMT) is made for cryogenic application by Hamamatsu. In this paper, we report on the measurement of relative quantum efficiency (QE) of this model PMT at liquid argon(LAr) temperature. Furthermore, a specially designed setup and relevant test method are introduced. The relative QE is measured in visible wavelengths with the PMT emerged in high purity nitrogen atmosphere. The results show that the change of QE at LAr temperature is within about 5% compared with room temperature around 420 nm. However, the QE increases about 10% in the shorter wavelength range and decreases significantly after 550 nm.

physics.ins-det↗
arXiv2021

Dynamics of Opinions with Bounded Confidence in Social Cliques: Emergence of Fluctuations

In this paper, we study the evolution of opinions over social networks with bounded confidence in social cliques. Node initial opinions are independently and identically distributed; at each time step, nodes review the average opinions of a randomly selected local clique. The clique averages may represent local group pressures on peers. Then nodes update their opinions under bounded confidence: only when the difference between an agent individual opinion and the corresponding local clique pressure is below a threshold, this agent opinion is updated according to the DeGroot rule as a weighted average of the two values. As a result, this opinion dynamics is a generalization of the classical Deffuant-Weisbuch model in which only pairwise interactions take place. First of all, we prove conditions under which all node opinions converge to finite limits. We show that in the limits the event that all nodes achieve a consensus, and the event that all nodes achieve pairwise distinct limits, i.e., social disagreements, are both nontrivial events. Next, we show that opinion fluctuations may take place in the sense that at least one agent in the network fails to hold a converging opinion trajectory. In fact, we prove that this fluctuation event happens with a strictly positive probability, and also constructively present an initial value event under which the fluctuation event arises with probability one. These results add to the understanding of the role of bounded confidence in social opinion dynamics, and the possibility of fluctuation reveals that bringing in cliques in Deffuant-Weisbuch models have fundamentally changed the behavior of such opinion dynamical processes.

cs.SI↗
arXiv2021

Adversarial Camera Alignment Network for Unsupervised Cross-camera Person Re-identification

In person re-identification (Re-ID), supervised methods usually need a large amount of expensive label information, while unsupervised ones are still unable to deliver satisfactory identification performance. In this paper, we introduce a novel person Re-ID task called unsupervised cross-camera person Re-ID, which only needs the within-camera (intra-camera) label information but not cross-camera (inter-camera) labels which are more expensive to obtain. In real-world applications, the intra-camera label information can be easily captured by tracking algorithms or few manual annotations. In this situation, the main challenge becomes the distribution discrepancy across different camera views, caused by the various body pose, occlusion, image resolution, illumination conditions, and background noises in different cameras. To address this situation, we propose a novel Adversarial Camera Alignment Network (ACAN) for unsupervised cross-camera person Re-ID. It consists of the camera-alignment task and the supervised within-camera learning task. To achieve the camera alignment, we develop a Multi-Camera Adversarial Learning (MCAL) to map images of different cameras into a shared subspace. Particularly, we investigate two different schemes, including the existing GRL (i.e., gradient reversal layer) scheme and the proposed scheme called "other camera equiprobability" (OCE), to conduct the multi-camera adversarial task. Based on this shared subspace, we then leverage the within-camera labels to train the network. Extensive experiments on five large-scale datasets demonstrate the superiority of ACAN over multiple state-of-the-art unsupervised methods that take advantage of labeled source domains and generated images by GAN-based models. In particular, we verify that the proposed multi-camera adversarial task does contribute to the significant improvement.

cs.CV↗
arXiv2021

Elastic energy of multi-component solid solutions and strain origins of phase stability in high-entropy alloys

The elastic energy of mixing for multi-component solid solutions is derived by generalizing Eshelby's sphere-in-hole model for binary alloys. By surveying the dependence of the elastic energy on chemical composition and lattice misfit, we propose a lattice strain coefficient λ*. Applying to several high-entropy alloys and superalloys, we found that most solid solution alloys are stable when λ*<0.16, analogous to the Hume-Rothery atomic-size rule for binary alloys. We also reveal that the polydispersity index δ, frequently used for describing strain in multi-component alloys, is directly related to the elastic energy (e) with e=qδ^2, q being an elastic constant. Furthermore, the effects of (i) the number and (ii) the atomic-size distribution of constituting elements on the phase stability of high-entropy alloys were quantified. The present derivations open for richer considerations of elastic effects in high-entropy alloys, offering immediate support for quantitative assessments of their thermodynamic properties and studying related strengthening mechanisms.

cond-mat.mtrl-sci↗