arXiv subjects

Nan Wang

Publications and source records attributed to Nan Wang.

At least 145 records · Page 8Linked to original sources

arXiv2023

SOK: Privacy Definitions and Classical Mechanisms in the Local Setting

This paper delves into the intricate landscape of privacy notions, specifically honed in on the local setting. Central to our discussion is the juxtaposition of point-wise protection and average-case protection, offering a comparative analysis that highlights the strengths and trade-offs inherent to each approach. Beyond this, we delineate between context-aware and context-free notions, examining the implications of both in diverse application scenarios. The study further differentiates between the interactive and non-interactive models, illuminating the complexities and nuances each model introduces. By systematically navigating these core themes, our goal is to provide a cohesive framework that aids researchers and practitioners in discerning the most suitable privacy notions for their specific requirements in the local setting.

cs.CR↗

arXiv2023

Colloidal Directional Structures at a Nematic Liquid Crystal-Air Interface

We present a variety of structures formed by colloidal droplets at a nematic liquid crystal-air interface, where the elastic dipole-dipole, quadrupole-quadrupole, and dipole-quadrupole interactions are all essentially involved. The colloidal structures observed not only include chains with kinks or clusters, but also comprise directional structures, such as directional chains and branches, whose direction is associated with the tilting director in the liquid crystal layer. The dipole-quadrupole interaction, originating from the polydispersity of the droplets, plays a central role for the formation of these directional structures. Clusters consisting of directional branches and chains are also observed and found to be fractal statistically.

cond-mat.soft↗

arXiv2023

BrainNPT: Pre-training of Transformer networks for brain network classification

Deep learning methods have advanced quickly in brain imaging analysis over the past few years, but they are usually restricted by the limited labeled data. Pre-trained model on unlabeled data has presented promising improvement in feature learning in many domains, including natural language processing and computer vision. However, this technique is under-explored in brain network analysis. In this paper, we focused on pre-training methods with Transformer networks to leverage existing unlabeled data for brain functional network classification. First, we proposed a Transformer-based neural network, named as BrainNPT, for brain functional network classification. The proposed method leveraged token as a classification embedding vector for the Transformer model to effectively capture the representation of brain network. Second, we proposed a pre-training framework for BrainNPT model to leverage unlabeled brain network data to learn the structure information of brain networks. The results of classification experiments demonstrated the BrainNPT model without pre-training achieved the best performance with the state-of-the-art models, and the BrainNPT model with pre-training strongly outperformed the state-of-the-art models. The pre-training BrainNPT model improved 8.75% of accuracy compared with the model without pre-training. We further compared the pre-training strategies, analyzed the influence of the parameters of the model, and interpreted the trained model.

q-bio.NC↗

arXiv2023

Optimal Hypothesis Testing Based on Information Theory

There has a major problem in the current theory of hypothesis testing in which no unified indicator to evaluate the goodness of various test methods since the cost function or utility function usually relies on the specific application scenario, resulting in no optimal hypothesis testing method. In this paper, the problem of optimal hypothesis testing is investigated based on information theory. We propose an information-theoretic framework of hypothesis testing consisting of five parts: test information (TI) is proposed to evaluate the hypothesis testing, which depends on the a posteriori probability distribution function of hypotheses and independent of specific test methods; accuracy with the unit of bit is proposed to evaluate the degree of validity of specific test methods; the sampling a posteriori (SAP) probability test method is presented, which makes stochastic selections on the hypotheses according to the a posteriori probability distribution of the hypotheses; the probability of test failure is defined to reflect the probability of the failed decision is made; test theorem is proved that all accuracy lower than the TI is achievable. Specifically, for every accuracy lower than TI, there exists a test method with the probability of test failure tending to zero. Conversely, there is no test method whose accuracy is more than TI. Numerical simulations are performed to demonstrate that the SAP test is asymptotically optimal. In addition, the results show that the accuracy of the SAP test and the existing test methods, such as the maximum a posteriori probability, expected a posteriori probability, and median a posteriori probability tests, are not more than TI.

math.ST↗

arXiv2023

Exploring Global and Local Information for Anomaly Detection with Normal Samples

Anomaly detection aims to detect data that do not conform to regular patterns, and such data is also called outliers. The anomalies to be detected are often tiny in proportion, containing crucial information, and are suitable for application scenes like intrusion detection, fraud detection, fault diagnosis, e-commerce platforms, et al. However, in many realistic scenarios, only the samples following normal behavior are observed, while we can hardly obtain any anomaly information. To address such problem, we propose an anomaly detection method GALDetector which is combined of global and local information based on observed normal samples. The proposed method can be divided into a three-stage method. Firstly, the global similar normal scores and the local sparsity scores of unlabeled samples are computed separately. Secondly, potential anomaly samples are separated from the unlabeled samples corresponding to these two scores and corresponding weights are assigned to the selected samples. Finally, a weighted anomaly detector is trained by loads of samples, then the detector is utilized to identify else anomalies. To evaluate the effectiveness of the proposed method, we conducted experiments on three categories of real-world datasets from diverse domains, and experimental results show that our method achieves better performance when compared with other state-of-the-art methods.

cs.LG↗

arXiv2023

HySST: A Stable Sparse Rapidly-Exploring Random Trees Optimal Motion Planning Algorithm for Hybrid Dynamical Systems

This paper proposes a stable sparse rapidly-exploring random trees (SST) algorithm to solve the optimal motion planning problem for hybrid systems. At each iteration, the proposed algorithm, called HySST, selects a vertex with the lowest cost among all the vertices within the neighborhood of a randomly selected sample and then extends the search tree by flow or jump, which is also chosen randomly when both regimes are possible. In addition, HySST maintains a static set of witness points such that all the vertices within the neighborhood of each witness are pruned except the vertex with the lowest cost. Through a definition of concatenation of functions defined on hybrid time domains, we show that HySST is asymptotically near optimal, namely, the probability of failing to find a motion plan such that its cost is close to the optimal cost approaches zero as the number of iterations of the algorithm increases to infinity. This property is guaranteed under mild conditions on the data defining the motion plan, which include a relaxation of the usual positive clearance assumption imposed in the literature of classical systems. The proposed algorithm is applied to an actuated bouncing ball system and a collision-resilient tensegrity multicopter system so as to highlight its generality and computational features.

cs.RO↗

arXiv2023

High dynamic range open-loop current measurement based on diamond quantum magnetometer achieving ppm scale precision

Negatively charged nitrogen-vacancy (NV) centers in diamond have been extensively studied as a promising high sensitivity solid-state magnetic field sensor at room temperature. However, their use for current sensing applications is limited due to the challenge of integration and miniaturization of the diamond NV sensor. Here, we demonstrate an integrated NV sensor fabricated with standard microfabrication process. The sensor device incorporated with a toroidal magnetic yoke enables a high-precision wide range direct current sensing with galvanic isolation. The performance of the diamond NV current sensor in an open loop configuration has been investigated. A current measuring range of 0 A ~ 1000 A with an uncertainty of 46 ppm are achieved. Taking advantage of dual spin resonance modulation, temperature drift is suppressed to 10 ppm/K. This configuration opens new possibilities as a robust and scalable platform for current quantum sensing technologies.

physics.ins-det↗

arXiv2023

Charge-density-wave resistive switching and voltage oscillations in ternary chalcogenide BaTiS3

Phase change materials, which show different electrical characteristics across the phase transitions, have attracted considerable research attention for their potential electronic device applications. Materials with metal-to-insulator or charge density wave (CDW) transitions such as VO2 and 1T-TaS2 have demonstrated voltage oscillations due to their robust bi-state resistive switching behavior with some basic neuronal characteristics. BaTiS3 is a small bandgap ternary chalcogenide that has recently reported the emergence CDW order below 245 K. Here, we report on the discovery of DC voltage / current-induced reversible threshold switching in BaTiS3 devices between a CDW phase and a room temperature semiconducting phase. The resistive switching behavior is consistent with a Joule heating scheme and sustained voltage oscillations with a frequency of up to 1 kHz has been demonstrated by leveraging the CDW phase transition and the associated negative differential resistance. Strategies of reducing channel sizes and improving thermal management may further improve the device performance. Our findings establish BaTiS3 as a promising CDW material for future energy-efficient electronics, especially for neuromorphic computing.

cond-mat.mtrl-sci↗

arXiv2023

A Cross-institutional Evaluation on Breast Cancer Phenotyping NLP Algorithms on Electronic Health Records

Objective: The generalizability of clinical large language models is usually ignored during the model development process. This study evaluated the generalizability of BERT-based clinical NLP models across different clinical settings through a breast cancer phenotype extraction task. Materials and Methods: Two clinical corpora of breast cancer patients were collected from the electronic health records from the University of Minnesota and the Mayo Clinic, and annotated following the same guideline. We developed three types of NLP models (i.e., conditional random field, bi-directional long short-term memory and CancerBERT) to extract cancer phenotypes from clinical texts. The models were evaluated for their generalizability on different test sets with different learning strategies (model transfer vs. locally trained). The entity coverage score was assessed with their association with the model performances. Results: We manually annotated 200 and 161 clinical documents at UMN and MC, respectively. The corpora of the two institutes were found to have higher similarity between the target entities than the overall corpora. The CancerBERT models obtained the best performances among the independent test sets from two clinical institutes and the permutation test set. The CancerBERT model developed in one institute and further fine-tuned in another institute achieved reasonable performance compared to the model developed on local data (micro-F1: 0.925 vs 0.932). Conclusions: The results indicate the CancerBERT model has the best learning ability and generalizability among the three types of clinical NLP models. The generalizability of the models was found to be correlated with the similarity of the target entities between the corpora.

cs.CL↗

arXiv2023

Clustered Data Sharing for Non-IID Federated Learning over Wireless Networks

Federated Learning (FL) is a novel distributed machine learning approach to leverage data from Internet of Things (IoT) devices while maintaining data privacy. However, the current FL algorithms face the challenges of non-independent and identically distributed (non-IID) data, which causes high communication costs and model accuracy declines. To address the statistical imbalances in FL, we propose a clustered data sharing framework which spares the partial data from cluster heads to credible associates through device-to-device (D2D) communication. Moreover, aiming at diluting the data skew on nodes, we formulate the joint clustering and data sharing problem based on the privacy-preserving constrained graph. To tackle the serious coupling of decisions on the graph, we devise a distribution-based adaptive clustering algorithm (DACA) basing on three deductive cluster-forming conditions, which ensures the maximum yield of data sharing. The experiments show that the proposed framework facilitates FL on non-IID datasets with better convergence and model accuracy under a limited communication environment.

cs.LG↗

arXiv2023

Practically Efficient Secure Computation of Rank-based Statistics Over Distributed Datasets

In this paper, we propose a practically efficient model for securely computing rank-based statistics, e.g., median, percentiles and quartiles, over distributed datasets in the malicious setting without leaking individual data privacy. Based on the binary search technique of Aggarwal et al. (EUROCRYPT \textquotesingle 04), we respectively present an interactive protocol and a non-interactive protocol, involving at most $\log ||R||$ rounds, where $||R||$ is the range size of the dataset elements. Besides, we introduce a series of optimisation techniques to reduce the round complexity. Our computing model is modular and can be instantiated with either homomorphic encryption or secret-sharing schemes. Compared to the state-of-the-art solutions, it provides stronger security and privacy while maintaining high efficiency and accuracy. Unlike differential-privacy-based solutions, it does not suffer a trade-off between accuracy and privacy. On the other hand, it only involves $O(N \log ||R||)$ time complexity, which is far more efficient than those bitwise-comparison-based solutions with $O(N^2\log ||R||)$ time complexity, where $N$ is the dataset size. Finally, we provide a UC-secure instantiation with the threshold Paillier cryptosystem and $Σ$-protocol zero-knowledge proofs of knowledge.

cs.CR↗

arXiv2022

Rank4Class: A Ranking Formulation for Multiclass Classification

Multiclass classification (MCC) is a fundamental machine learning problem of classifying each instance into one of a predefined set of classes. In the deep learning era, extensive efforts have been spent on developing more powerful neural embedding models to better represent the instance for improving MCC performance. In this paper, we do not aim to propose new neural models for instance representation learning, but to show that it is promising to boost MCC performance with a novel formulation through the lens of ranking. In particular, by viewing MCC as to rank classes for an instance, we first argue that ranking metrics, such as Normalized Discounted Cumulative Gain, can be more informative than the commonly used Top-$K$ metrics. We further demonstrate that the dominant neural MCC recipe can be transformed to a neural ranking framework. Based on such generalization, we show that it is intuitive to leverage advanced techniques from the learning to rank literature to improve the MCC performance out of the box. Extensive empirical results on both text and image classification tasks with diverse datasets and backbone neural models show the value of our proposed framework.

cs.LG↗

arXiv2022

A Rapidly-Exploring Random Trees Motion Planning Algorithm for Hybrid Dynamical Systems

This paper proposes a rapidly-exploring random trees (RRT) algorithm to solve the motion planning problem for hybrid systems. At each iteration, the proposed algorithm, called HyRRT, randomly picks a state sample and extends the search tree by flow or jump, which is also chosen randomly when both regimes are possible. Through a definition of concatenation of functions defined on hybrid time domains, we show that HyRRT is probabilistically complete, namely, the probability of failing to find a motion plan approaches zero as the number of iterations of the algorithm increases. This property is guaranteed under mild conditions on the data defining the motion plan, which include a relaxation of the usual positive clearance assumption imposed in the literature of classical systems. The motion plan is computed through the solution of two optimization problems, one associated with the flow and the other with the jumps of the system. The proposed algorithm is applied to a walking robot so as to highlight its generality and computational features.

cs.RO↗

arXiv2022

Devaney Chaos on a Set-valued Map and Its Inverse Limit

We study relationships between a set-valued map and its inverse limits about the notion of periodic point set, transitivity, sensitivity and Devaney chaos. Density of periodic point set of a set-valued map and its inverse limits implies each other. Sensitivity of a set-valued map and its inverse limits does not imply each other. Transitivity and Devaney chaos of generalized inverse limits implies the corresponding property of a set-valued map.

math.DS↗

arXiv2022

Realization of high-dynamic-range broadband magnetic-field sensing with ensemble nitrogen-vacancy centers in diamond

We present a new magnetometry method integrating an ensemble of nitrogen-vacancy (NV) centers in a single-crystal diamond with an extended dynamic range for monitoring the fast changing magnetic-field. The NV-center spin resonance frequency is tracked using a closed-loop frequency locked technique with fast frequency hopping to achieve a 10 kHz measurement bandwidth, thus, allowing for the detection of fast changing magnetic signals up to 0.723 T/s.This technique exhibits an extended dynamic range subjected to the working bandwidth of the microwave source. This extended dynamic range can reach up to 4.3 mT, which is 86 times broader than the intrinsic dynamic range. The essential components for NV spin control and signal processing such as signal generation, microwave frequency control, data processing and readout are integrated in a board-level system. With this platform, we demonstrate broadband magnetometry with an optimized sensitivity of 4.2 nT-Hz-1/2. This magnetometry method has the potential to be implemented in a multichannel frequency locked vector magnetometer suitable for a wide range of practical applications such as magnetocardiography and high-precision current sensors.

quant-ph↗

arXiv2022

An MRC Framework for Semantic Role Labeling

Semantic Role Labeling (SRL) aims at recognizing the predicate-argument structure of a sentence and can be decomposed into two subtasks: predicate disambiguation and argument labeling. Prior work deals with these two tasks independently, which ignores the semantic connection between the two tasks. In this paper, we propose to use the machine reading comprehension (MRC) framework to bridge this gap. We formalize predicate disambiguation as multiple-choice machine reading comprehension, where the descriptions of candidate senses of a given predicate are used as options to select the correct sense. The chosen predicate sense is then used to determine the semantic roles for that predicate, and these semantic roles are used to construct the query for another MRC model for argument labeling. In this way, we are able to leverage both the predicate semantics and the semantic role semantics for argument labeling. We also propose to select a subset of all the possible semantic roles for computational efficiency. Experiments show that the proposed framework achieves state-of-the-art or comparable results to previous work. Code is available at \url{https://github.com/ShannonAI/MRC-SRL}.

cs.CL↗

arXiv2022

GATE: Graph CCA for Temporal SElf-supervised Learning for Label-efficient fMRI Analysis

In this work, we focus on the challenging task, neuro-disease classification, using functional magnetic resonance imaging (fMRI). In population graph-based disease analysis, graph convolutional neural networks (GCNs) have achieved remarkable success. However, these achievements are inseparable from abundant labeled data and sensitive to spurious signals. To improve fMRI representation learning and classification under a label-efficient setting, we propose a novel and theory-driven self-supervised learning (SSL) framework on GCNs, namely Graph CCA for Temporal self-supervised learning on fMRI analysis GATE. Concretely, it is demanding to design a suitable and effective SSL strategy to extract formation and robust features for fMRI. To this end, we investigate several new graph augmentation strategies from fMRI dynamic functional connectives (FC) for SSL training. Further, we leverage canonical-correlation analysis (CCA) on different temporal embeddings and present the theoretical implications. Consequently, this yields a novel two-step GCN learning procedure comprised of (i) SSL on an unlabeled fMRI population graph and (ii) fine-tuning on a small labeled fMRI dataset for a classification task. Our method is tested on two independent fMRI datasets, demonstrating superior performance on autism and dementia diagnosis.

cs.LG↗

arXiv2022

Unconventional Charge-density-wave Order in a Dilute d-band Semiconductor

Electron-lattice coupling effects in low dimensional materials give rise to charge density wave (CDW) order and phase transitions. These phenomena are critical ingredients for superconductivity and predominantly occur in metallic model systems such as doped cuprates, transition metal dichalcogenides, and more recently, in Kagome lattice materials. However, CDW in semiconducting systems, specifically at the limit of low carrier concentration region, is uncommon. Here, we combine electrical transport, synchrotron X-ray diffraction and optical spectroscopy to discover CDW order in a quasi-one-dimensional (1D), dilute d-band semiconductor, BaTiS3, which suggests the existence of strong electron-phonon coupling. The CDW state further undergoes an unusual transition featuring a sharp increase in carrier mobility. Our work establishes BaTiS3 as a unique platform to study the CDW physics in the dilute filling limit to explore novel electronic phases.

cond-mat.mtrl-sci↗