arXiv subjects

Yi Liu

Publications and source records attributed to Yi Liu.

At least 667 records · Page 37Linked to original sources

arXiv2021

CleftNet: Augmented Deep Learning for Synaptic Cleft Detection from Brain Electron Microscopy

Detecting synaptic clefts is a crucial step to investigate the biological function of synapses. The volume electron microscopy (EM) allows the identification of synaptic clefts by photoing EM images with high resolution and fine details. Machine learning approaches have been employed to automatically predict synaptic clefts from EM images. In this work, we propose a novel and augmented deep learning model, known as CleftNet, for improving synaptic cleft detection from brain EM images. We first propose two novel network components, known as the feature augmentor and the label augmentor, for augmenting features and labels to improve cleft representations. The feature augmentor can fuse global information from inputs and learn common morphological patterns in clefts, leading to augmented cleft features. In addition, it can generate outputs with varying dimensions, making it flexible to be integrated in any deep network. The proposed label augmentor augments the label of each voxel from a value to a vector, which contains both the segmentation label and boundary label. This allows the network to learn important shape information and to produce more informative cleft representations. Based on the proposed feature augmentor and label augmentor, We build the CleftNet as a U-Net like network. The effectiveness of our methods is evaluated on both online and offline tasks. Our CleftNet currently ranks \#1 on the online task of the CREMI open challenge. In addition, both quantitative and qualitative results in the offline tasks show that our method outperforms the baseline approaches significantly.

cs.CV↗

arXiv2020

Towards Communication-efficient and Attack-Resistant Federated Edge Learning for Industrial Internet of Things

Federated Edge Learning (FEL) allows edge nodes to train a global deep learning model collaboratively for edge computing in the Industrial Internet of Things (IIoT), which significantly promotes the development of Industrial 4.0. However, FEL faces two critical challenges: communication overhead and data privacy. FEL suffers from expensive communication overhead when training large-scale multi-node models. Furthermore, due to the vulnerability of FEL to gradient leakage and label-flipping attacks, the training process of the global model is easily compromised by adversaries. To address these challenges, we propose a communication-efficient and privacy-enhanced asynchronous FEL framework for edge computing in IIoT. First, we introduce an asynchronous model update scheme to reduce the computation time that edge nodes wait for global model aggregation. Second, we propose an asynchronous local differential privacy mechanism, which improves communication efficiency and mitigates gradient leakage attacks by adding well-designed noise to the gradients of edge nodes. Third, we design a cloud-side malicious node detection mechanism to detect malicious nodes by testing the local model quality. Such a mechanism can avoid malicious nodes participating in training to mitigate label-flipping attacks. Extensive experimental studies on two real-world datasets demonstrate that the proposed framework can not only improve communication efficiency but also mitigate malicious attacks while its accuracy is comparable to traditional FEL frameworks.

cs.LG↗

arXiv2020

A Systematic Literature Review on Federated Learning: From A Model Quality Perspective

As an emerging technique, Federated Learning (FL) can jointly train a global model with the data remaining locally, which effectively solves the problem of data privacy protection through the encryption mechanism. The clients train their local model, and the server aggregates models until convergence. In this process, the server uses an incentive mechanism to encourage clients to contribute high-quality and large-volume data to improve the global model. Although some works have applied FL to the Internet of Things (IoT), medicine, manufacturing, etc., the application of FL is still in its infancy, and many related issues need to be solved. Improving the quality of FL models is one of the current research hotspots and challenging tasks. This paper systematically reviews and objectively analyzes the approaches to improving the quality of FL models. We are also interested in the research and application trends of FL and the effect comparison between FL and non-FL because the practitioners usually worry that achieving privacy protection needs compromising learning quality. We use a systematic review method to analyze 147 latest articles related to FL. This review provides useful information and insights to both academia and practitioners from the industry. We investigate research questions about academic research and industrial application trends of FL, essential factors affecting the quality of FL models, and compare FL and non-FL algorithms in terms of learning quality. Based on our review's conclusion, we give some suggestions for improving the FL model quality. Finally, we propose an FL application framework for practitioners.

cs.LG↗

arXiv2020

Broken Adaptive Ridge Regression for Right-Censored Survival Data

Broken adaptive ridge (BAR) is a computationally scalable surrogate to $L_0$-penalized regression, which involves iteratively performing reweighted $L_2$ penalized regressions and enjoys some appealing properties of both $L_0$ and $L_2$ penalized regressions while avoiding some of their limitations. In this paper, we extend the BAR method to the semi-parametric accelerated failure time (AFT) model for right-censored survival data. Specifically, we propose a censored BAR (CBAR) estimator by applying the BAR algorithm to the Leurgan's synthetic data and show that the resulting CBAR estimator is consistent for variable selection, possesses an oracle property for parameter estimation {and enjoys a grouping property for highly correlation covariates}. Both low and high dimensional covariates are considered. The effectiveness of our method is demonstrated and compared with some popular penalization methods using simulations. Real data illustrations are provided on a diffuse large-B-cell lymphoma data and a glioblastoma multiforme data.

stat.ME↗

arXiv2020

A Systematic Construction of MDS Codes With Small Sub-packetization Level and Near-Optimal Repair Bandwidth

In the literature, all the known high-rate MDS codes with the optimal repair bandwidth possess a significantly large sub-packetization level, which may prevent the codes to be implemented in practical systems. To build MDS codes with small sub-packetization level, existing constructions and theoretical bounds imply that one may sacrifice the optimality of the repair bandwidth. Partly motivated by the work of Tamo et al. (IEEE Trans. Inform. Theory, 59(3), 1597-1616, 2013), in this paper, we present a transformation that can greatly reduce the sub-packetization level of MDS codes with the optimal repair bandwidth with respect to the same code length n. As applications of the transformation, four high-rate MDS codes having both small sub-packetization level and near-optimal repair bandwidth can be obtained, where three of them are explicit and the required field sizes are around or even smaller than the code length n. Additionally, we propose another explicit MDS code which has a similar structure as that of the first resultant code obtained by the generic transformation, but can be built on a smaller finite field.

cs.IT↗

arXiv2020

The motion of respiratory droplets produced by coughing

Coronavirus disease 2019 (COVID-19) has become a global pandemic infectious respiratory disease with high mortality and infectiousness. This paper investigates respiratory droplet transmission, which is critical to understanding, modeling and controlling epidemics. In the present work, we implemented flow visualization, particle image velocimetry (PIV) and particle shadow tracking velocimetry (PSTV) to measure the velocity of the airflow and droplets involved in coughing and then constructed a physical model considering the evaporation effect to predict the motion of droplets under different weather conditions. The experimental results indicate that the convection velocity of cough airflow presents the relationship $t^{-0.7}$ with time; hence, the distance from the cougher increases by $t^{0.3}$ in the range of our measurement domain. Substituting these experimental results into the physical model reveals that the small droplets (initial diameter $D \leq$ 100 $μ$m) evaporate to droplet nuclei and that the large droplets with $D \geq$ 500 $μ$m and initial velocity $u_0 \geq$ 5 m/s travel more than 2 m. Winter conditions of low temperature and high relative humidity can cause more droplets to settle to the ground, which may be a possible driver of a second pandemic wave in the autumn and winter seasons.

physics.flu-dyn↗

arXiv2020

Topology-Aware Graph Pooling Networks

Pooling operations have shown to be effective on computer vision and natural language processing tasks. One challenge of performing pooling operations on graph data is the lack of locality that is not well-defined on graphs. Previous studies used global ranking methods to sample some of the important nodes, but most of them are not able to incorporate graph topology. In this work, we propose the topology-aware pooling (TAP) layer that explicitly considers graph topology. Our TAP layer is a two-stage voting process that selects more important nodes in a graph. It first performs local voting to generate scores for each node by attending each node to its neighboring nodes. The scores are generated locally such that topology information is explicitly considered. In addition, graph topology is incorporated in global voting to compute the importance score of each node globally in the entire graph. Altogether, the final ranking score for each node is computed by combining its local and global voting scores. To encourage better graph connectivity in the sampled graph, we propose to add a graph connectivity term to the computation of ranking scores. Results on graph classification tasks demonstrate that our methods achieve consistently better performance than previous methods.

cs.LG↗

arXiv2020

Anomalous linear magnetoresistance in high quality crystalline lead thin films

Intriguing novel phenomena in lead films inspire new understanding of quantum physics, such as quantum size effect and quantum phase transitions etc. The improvement of the sample quality makes it even more promising to explore the intrinsic properties in two-dimensional system. In this paper, we show that the crystalline interfacial striped incommensurate layer can increase the quality of the lead films and significantly enhance the magnitude of magnetoresistance. By performing systematic transport measurement, a predominant anomalous linear magnetoresistance is revealed, and the widely used Parish-Littlewood model and Abrikosov's explanation fail to describe the observation. Instead, we propose a new model of linear magnetoresistance based on linear band structure, which shows a good agreement with the experimental results. Our studies reveal a novel origin of linear magnetoresistance which may also be helpful to understand the linear magnetoresistance in other materials with linear dispersion of electronic structure.

cond-mat.mes-hall↗

arXiv2020

Hidden-bottom molecular states from $Σ^{()}_bB^{()}-Λ_bB^{(*)}$ interaction

In this work, we study possible hidden-bottom molecular pentaquarks $P_b$ from coupled-channel $Σ^{(*)}_bB^{(*)}-Λ_bB^{(*)}$ interaction in the quasipotential Bethe-Salpeter equation approach. In isodoublet sector with $I=1/2$, with the same reasonable parameters the interaction produces seven molecular states, a state near $ Σ_bB$ threshold with spin parity $J^P=1/2^-$, a state near $Σ^*_bB$ threshold with $3/2^-$, two states near $Σ_bB^*$ threshold with $1/2^-$ and $3/2^-$, and three states near $Σ_b^*B^*$ threshold with $1/2^-$, $3/2^-$, and $5/2^-$. The results suggest that three states near $Σ_b^* B^*$ threshold and two states near $Σ_b B^*$ threshold are very close, respectively, which may be difficult to distinguish in experiment without partial wave analysis. Compared with the hidden-charm pentaquark, the $P_b$ states are relatively narrow with widths at an order of magnitude of 1 MeV or smaller. The importance of each channel considered is also discussed, and it is found that the $Λ_b B^*$ channel provides important contribution for the widths of those states. In isoquartet sector with $I=3/2$, cutoff should be considerably enlarged to achieve bound states from the interaction, which makes the existence of such states unreliable. The results in the current work are helpful for searching for hidden-bottom molecular pentaquarks in future experiments, such as the COMPASS, J-PARC, and the Electron Ion Collider in China (EicC).

hep-ph↗

arXiv2020

Long-Range Exciton Diffusion in Two-Dimensional Assemblies of Cesium Lead Bromide Perovskite Nanocrystals

Förster Resonant Energy Transfer (FRET)-mediated exciton diffusion through artificial nanoscale building block assemblies could be used as a new optoelectronic design element to transport energy. However, so far nanocrystal (NC) systems supported only diffusion length of 30 nm, which are too small to be useful in devices. Here, we demonstrate a FRET-mediated exciton diffusion length of 200 nm with 0.5 cm2/s diffusivity through an ordered, two-dimensional assembly of cesium lead bromide perovskite nanocrystals (PNC). Exciton diffusion was directly measured via steady-state and time-resolved photoluminescence (PL) microscopy, with physical modeling providing deeper insight into the transport process. This exceptionally efficient exciton transport is facilitated by PNCs high PL quantum yield, large absorption cross-section, and high polarizability, together with minimal energetic and geometric disorder of the assembly. This FRET-mediated exciton diffusion length matches perovskites optical absorption depth, opening the possibility to design new optoelectronic device architectures with improved performances, and providing insight into the high conversion efficiencies of PNC-based optoelectronic devices.

physics.app-ph↗

arXiv2020

The Deep Learning Compiler: A Comprehensive Survey

The difficulty of deploying various deep learning (DL) models on diverse DL hardware has boosted the research and development of DL compilers in the community. Several DL compilers have been proposed from both industry and academia such as Tensorflow XLA and TVM. Similarly, the DL compilers take the DL models described in different DL frameworks as input, and then generate optimized codes for diverse DL hardware as output. However, none of the existing survey has analyzed the unique design architecture of the DL compilers comprehensively. In this paper, we perform a comprehensive survey of existing DL compilers by dissecting the commonly adopted design in details, with emphasis on the DL oriented multi-level IRs, and frontend/backend optimizations. Specifically, we provide a comprehensive comparison among existing DL compilers from various aspects. In addition, we present detailed analysis on the design of multi-level IRs and illustrate the commonly adopted optimization techniques. Finally, several insights are highlighted as the potential research directions of DL compiler. This is the first survey paper focusing on the design architecture of DL compilers, which we hope can pave the road for future research towards DL compiler.

cs.DC↗

arXiv2020

Large-Scale Analysis of Iliopsoas Muscle Volumes in the UK Biobank

Psoas muscle measurements are frequently used as markers of sarcopenia and predictors of health. Manually measured cross-sectional areas are most commonly used, but there is a lack of consistency regarding the position of the measurementand manual annotations are not practical for large population studies. We have developed a fully automated method to measure iliopsoas muscle volume (comprised of the psoas and iliacus muscles) using a convolutional neural network. Magnetic resonance images were obtained from the UK Biobank for 5,000 male and female participants, balanced for age, gender and BMI. Ninety manual annotations were available for model training and validation. The model showed excellent performance against out-of-sample data (dice score coefficient of 0.912 +/- 0.018). Iliopsoas muscle volumes were successfully measured in all 5,000 participants. Iliopsoas volume was greater in male compared with female subjects. There was a small but significant asymmetry between left and right iliopsoas muscle volumes. We also found that iliopsoas volume was significantly related to height, BMI and age, and that there was an acceleration in muscle volume decrease in men with age. Our method provides a robust technique for measuring iliopsoas muscle volume that can be applied to large cohorts.

eess.IV↗

arXiv2020

Topological Dirac states in a layered telluride TaPdTe$_5$ with quasi-one-dimensional PdTe$_2$ chains

We report the synthesis and systematic studies of a new layered ternary telluride TaPdTe5 with quasi-one-dimensional PdTe2 chains. This compound crystalizes in a layered orthorhombic structure with space group Cmcm. Analysis of its curved field-dependent Hall resistivity, using the two-band model, indicates the hole-dominated transport with a high mobility $μ_h$ = 2.38 $\times$ 10$^3$ cm$^2$ V$^{-1}$ s$^{-1}$ at low temperatures. The in-plane magnetoresistance (MR) displays significant anisotropy with field applied along the crystallographic $b$ axis. The MR with the current applied along the $c$-axis is also measured in high magnetic fields up to 51.7 T. Remarkably, it follows a power-law dependence and reaches (9.5 $\times$ 10$^3$)% at 2.1 K without any signature of saturation. The De Haas-van Alphen oscillations show a small Fermi-surface pocket with a nontrivial Berry phase. The Shubnikov-de Haas (SdH) oscillations are detected at low temperatures and under magnetic fields above 28.5 T. Two effective masses $m^*$ (0.26$m_e$ and 0.41$m_e$) are extracted from the oscillatory SdH data. Our first-principles calculations unveil a topological Dirac cone in its surface states, and, in particular, the topological index indicates that TaPdTe$_5$ is a topologically nontrivial material.

cond-mat.str-el↗

arXiv2020

Scalable and Communication-efficient Decentralized Federated Edge Learning with Multi-blockchain Framework

The emerging Federated Edge Learning (FEL) technique has drawn considerable attention, which not only ensures good machine learning performance but also solves "data island" problems caused by data privacy concerns. However, large-scale FEL still faces following crucial challenges: (i) there lacks a secure and communication-efficient model training scheme for FEL; (2) there is no scalable and flexible FEL framework for updating local models and global model sharing (trading) management. To bridge the gaps, we first propose a blockchain-empowered secure FEL system with a hierarchical blockchain framework consisting of a main chain and subchains. This framework can achieve scalable and flexible decentralized FEL by individually manage local model updates or model sharing records for performance isolation. A Proof-of-Verifying consensus scheme is then designed to remove low-quality model updates and manage qualified model updates in a decentralized and secure manner, thereby achieving secure FEL. To improve communication efficiency of the blockchain-empowered FEL, a gradient compression scheme is designed to generate sparse but important gradients to reduce communication overhead without compromising accuracy, and also further strengthen privacy preservation of training data. The security analysis and numerical results indicate that the proposed schemes can achieve secure, scalable, and communication-efficient decentralized FEL.

cs.CR↗

arXiv2020

The $X(2239)$ and $η(2225)$ as hidden-strange molecular states from $Λ\barΛ$ interaction

In this work, we propose a possible assignment of the newly observed $X(2239)$, as well as the $η(2225)$, as a molecular state from the interaction of a baryon $Λ$ and an antibaryon $\barΛ$. With the help of effective Lagrangians, the $Λ\barΛ$ interaction is described within the one-boson-exchange model with $η$, $η'$, $ω$, $ϕ$, and $σ$ exchanges considered. After inserting the potential kernel into the quasipotential Bethe-Salpeter equation, the bound states from the $Λ\barΛ$ interaction can be studied by searching for the pole of the scattering amplitude. Two loosely bound states with spin parities $I^G(J^{PC})=0^+(0^{-+})$ and $0^-(1^{--})$ appear near the threshold almost with the same parameter. The $0^-(1^{--})$ state can be assigned to the $X(2239)$ observed at BESIII, which is very close to the $Λ\barΛ$ threshold. The scalar meson $η(2225)$ can be interpreted as a $0^+(0^{-+})$ state from the $Λ\barΛ$ interaction. The annihilation effect is also discussed through a coupled-channel calculation plus a phenomenological optical potential. It provides large widths to two bound states produced from the $Λ\barΛ$ interaction. The mass of the $1^-$ state is a little larger than the mass of the $0^-$ state after including the annihilation effect, which is consistent with our assignment of these two states as $X(2239)$ and $η(2225)$, respectively. The results suggest that further investigation is expected to understand the structures near the $Λ\barΛ$ threshold, such as $X(2239)$, $η(2225)$, and $X(2175)$.

hep-ph↗

arXiv2020

PR-NN: RNN-based Detection for Coded Partial-Response Channels

In this paper, we investigate the use of recurrent neural network (RNN)-based detection of magnetic recording channels with inter-symbol interference (ISI). We refer to the proposed detection method, which is intended for recording channels with partial-response equalization, as Partial-Response Neural Network (PR-NN). We train bi-directional gated recurrent units (bi-GRUs) to recover the ISI channel inputs from noisy channel output sequences and evaluate the network performance when applied to continuous, streaming data. The computational complexity of PR-NN during the evaluation process is comparable to that of a Viterbi detector. The recording system on which the experiments were conducted uses a rate-2/3, (1,7) runlength-limited (RLL) code with an E2PR4 partial-response channel target. Experimental results with ideal PR signals show that the performance of PR-NN detection approaches that of Viterbi detection in additive white gaussian noise (AWGN). Moreover, the PR-NN detector outperforms Viterbi detection and achieves the performance of Noise-Predictive Maximum Likelihood (NPML) detection in additive colored noise (ACN) at different channel densities. A PR-NN detector trained with both AWGN and ACN maintains the performance observed under separate training. Similarly, when trained with ACN corresponding to two different channel densities, PR-NN maintains its performance at both densities. Experiments confirm that this robustness is consistent over a wide range of signal-to-noise ratios (SNRs). Finally, PR-NN displays robust performance when applied to a more realistic magnetic recording channel with MMSE-equalized Lorentzian signals.

cs.IT↗

arXiv2020

Machine Learning Explanations to Prevent Overtrust in Fake News Detection

Combating fake news and misinformation propagation is a challenging task in the post-truth era. News feed and search algorithms could potentially lead to unintentional large-scale propagation of false and fabricated information with users being exposed to algorithmically selected false content. Our research investigates the effects of an Explainable AI assistant embedded in news review platforms for combating the propagation of fake news. We design a news reviewing and sharing interface, create a dataset of news stories, and train four interpretable fake news detection algorithms to study the effects of algorithmic transparency on end-users. We present evaluation results and analysis from multiple controlled crowdsourced studies. For a deeper understanding of Explainable AI systems, we discuss interactions between user engagement, mental model, trust, and performance measures in the process of explaining. The study results indicate that explanations helped participants to build appropriate mental models of the intelligent assistants in different conditions and adjust their trust accordingly for model limitations.

cs.IR↗

arXiv2020

Federated Learning in the Sky: Aerial-Ground Air Quality Sensing Framework with UAV Swarms

Due to air quality significantly affects human health, it is becoming increasingly important to accurately and timely predict the Air Quality Index (AQI). To this end, this paper proposes a new federated learning-based aerial-ground air quality sensing framework for fine-grained 3D air quality monitoring and forecasting. Specifically, in the air, this framework leverages a light-weight Dense-MobileNet model to achieve energy-efficient end-to-end learning from haze features of haze images taken by Unmanned Aerial Vehicles (UAVs) for predicting AQI scale distribution. Furthermore, the Federated Learning Framework not only allows various organizations or institutions to collaboratively learn a well-trained global model to monitor AQI without compromising privacy, but also expands the scope of UAV swarms monitoring. For ground sensing systems, we propose a Graph Convolutional neural network-based Long Short-Term Memory (GC-LSTM) model to achieve accurate, real-time and future AQI inference. The GC-LSTM model utilizes the topological structure of the ground monitoring station to capture the spatio-temporal correlation of historical observation data, which helps the aerial-ground sensing system to achieve accurate AQI inference. Through extensive case studies on a real-world dataset, numerical results show that the proposed framework can achieve accurate and energy-efficient AQI sensing without compromising the privacy of raw data.

eess.SP↗