arXiv subjects

Jie Wang

Publications and source records attributed to Jie Wang.

At least 487 records · Page 27Linked to original sources

arXiv2022

Attention-Guided Black-box Adversarial Attacks with Large-Scale Multiobjective Evolutionary Optimization

Fooling deep neural networks (DNNs) with the black-box optimization has become a popular adversarial attack fashion, as the structural prior knowledge of DNNs is always unknown. Nevertheless, recent black-box adversarial attacks may struggle to balance their attack ability and visual quality of the generated adversarial examples (AEs) in tackling high-resolution images. In this paper, we propose an attention-guided black-box adversarial attack based on the large-scale multiobjective evolutionary optimization, termed as LMOA. By considering the spatial semantic information of images, we firstly take advantage of the attention map to determine the perturbed pixels. Instead of attacking the entire image, reducing the perturbed pixels with the attention mechanism can help to avoid the notorious curse of dimensionality and thereby improves the performance of attacking. Secondly, a large-scale multiobjective evolutionary algorithm is employed to traverse the reduced pixels in the salient region. Benefiting from its characteristics, the generated AEs have the potential to fool target DNNs while being imperceptible by the human vision. Extensive experimental results have verified the effectiveness of the proposed LMOA on the ImageNet dataset. More importantly, it is more competitive to generate high-resolution AEs with better visual quality compared with the existing black-box adversarial attacks.

cs.CV↗

arXiv2022

Phase Diagram of Infinite-layer Nickelate Compounds from First- and Second-principles Calculations

The fundamental properties of infinite-layer rare-earth nickelates (RNiO2) are carefully revisited and compared with those of CaCuO2 and RNiO3 perovskites. Combining first-principles and finite-temperature second-principles calculations, we highlight that bulk NdNiO2 compound are far from equivalent to CaCuO2, together at the structural, electronic, and magnetic levels. Structurally, it is shown to be prone to spin-phonon coupling induced oxygen square rotation motion, which might be responsible for the intriguing upturn of the resistivity. At the electronic and magnetic levels, we point out orbital-selective Mott localization with strong out-of-plane band dispersion, which should result in the isotropic upper critical fields and weakly three-dimensional magnetic interactions with in-plane local moment and out-of-plane itinerant moment. We further demonstrate that as in RNiO3 perovskites, oxygen rotation motion and rare-earth ion controlled electronic and magnetic properties can give rise in RNiO2 compounds to a rich phase diagram and high tunability of various appealing properties. In line with that, we reveal that key ingredients of high-Tc superconductor such as orbital polarization, Fermi surface, and antiferromagnetic interactions can be deliberately controlled in NdNiO2 through epitaxial strain. Exploiting strain-orbital engineering, a crossover from three- to two-dimensional magnetic transition can be established, making then NdNiO2 thin film a true analog of high-Tc cuprates.

cond-mat.mtrl-sci↗

arXiv2021

ConE: Cone Embeddings for Multi-Hop Reasoning over Knowledge Graphs

Query embedding (QE) -- which aims to embed entities and first-order logical (FOL) queries in low-dimensional spaces -- has shown great power in multi-hop reasoning over knowledge graphs. Recently, embedding entities and queries with geometric shapes becomes a promising direction, as geometric shapes can naturally represent answer sets of queries and logical relationships among them. However, existing geometry-based models have difficulty in modeling queries with negation, which significantly limits their applicability. To address this challenge, we propose a novel query embedding model, namely Cone Embeddings (ConE), which is the first geometry-based QE model that can handle all the FOL operations, including conjunction, disjunction, and negation. Specifically, ConE represents entities and queries as Cartesian products of two-dimensional cones, where the intersection and union of cones naturally model the conjunction and disjunction operations. By further noticing that the closure of complement of cones remains cones, we design geometric complement operators in the embedding space for the negation operations. Experiments demonstrate that ConE significantly outperforms existing state-of-the-art methods on benchmark datasets.

cs.AI↗

arXiv2021

Learning Robust Policy against Disturbance in Transition Dynamics via State-Conservative Policy Optimization

Deep reinforcement learning algorithms can perform poorly in real-world tasks due to the discrepancy between source and target environments. This discrepancy is commonly viewed as the disturbance in transition dynamics. Many existing algorithms learn robust policies by modeling the disturbance and applying it to source environments during training, which usually requires prior knowledge about the disturbance and control of simulators. However, these algorithms can fail in scenarios where the disturbance from target environments is unknown or is intractable to model in simulators. To tackle this problem, we propose a novel model-free actor-critic algorithm -- namely, state-conservative policy optimization (SCPO) -- to learn robust policies without modeling the disturbance in advance. Specifically, SCPO reduces the disturbance in transition dynamics to that in state space and then approximates it by a simple gradient-based regularizer. The appealing features of SCPO include that it is simple to implement and does not require additional knowledge about the disturbance or specially designed simulators. Experiments in several robot control tasks demonstrate that SCPO learns robust policies against the disturbance in transition dynamics.

cs.LG↗

arXiv2021

EmotionBox: a music-element-driven emotional music generation system using Recurrent Neural Network

With the development of deep neural networks, automatic music composition has made great progress. Although emotional music can evoke listeners' different emotions and it is important for artistic expression, only few researches have focused on generating emotional music. This paper presents EmotionBox -an music-element-driven emotional music generator that is capable of composing music given a specific emotion, where this model does not require a music dataset labeled with emotions. Instead, pitch histogram and note density are extracted as features that represent mode and tempo respectively to control music emotions. The subjective listening tests show that the Emotionbox has a more competitive and balanced performance in arousing a specified emotion than the emotion-label-based method.

cs.SD↗

arXiv2021

Sample-Efficient Reinforcement Learning via Conservative Model-Based Actor-Critic

Model-based reinforcement learning algorithms, which aim to learn a model of the environment to make decisions, are more sample efficient than their model-free counterparts. The sample efficiency of model-based approaches relies on whether the model can well approximate the environment. However, learning an accurate model is challenging, especially in complex and noisy environments. To tackle this problem, we propose the conservative model-based actor-critic (CMBAC), a novel approach that achieves high sample efficiency without the strong reliance on accurate learned models. Specifically, CMBAC learns multiple estimates of the Q-value function from a set of inaccurate models and uses the average of the bottom-k estimates -- a conservative estimate -- to optimize the policy. An appealing feature of CMBAC is that the conservative estimates effectively encourage the agent to avoid unreliable "promising actions" -- whose values are high in only a small fraction of the models. Experiments demonstrate that CMBAC significantly outperforms state-of-the-art approaches in terms of sample efficiency on several challenging tasks, and the proposed method is more robust than previous methods in noisy environments.

cs.LG↗

arXiv2021

Radio Frequency Interference Mitigation and Statistics in the Spectral Observations of FAST

In radio astronomy, radio frequency interference (RFI) becomes more and more serious for radio observational facilities. The RFI always influences the search and study of the interesting astronomical objects. Mitigating the RFI becomes an essential procedure in any survey data processing. Five-hundred-meter Aperture Spherical radio Telescope (FAST) is an extremely sensitive radio telescope. It is necessary to find out an effective and precise RFI mitigation method for FAST data processing. In this work, we introduce a method to mitigate the RFI in FAST spectral observation and make a statistics for the RFI using around 300 hours FAST data. The details are as follows. Firstly, according to the characteristics of FAST spectra, we propose to use the ArPLS algorithm for baseline fitting. Our test results show that it has a good performance. Secondly, we flag the RFI with four strategies, which are to flag extremely strong RFI, flag long-lasting RFI, flag polarized RFI, and flag beam-combined RFI, respectively. The test results show that all the RFI above a preset threshold could be flagged. Thirdly, we make a statistics for the probabilities of polarized XX and YY RFI in FAST observations. The statistical results could tell us which frequencies are relatively quiescent. With such statistical data, we are able to avoid using such frequencies in our spectral observations. Finally, based on the around 300 hours FAST data, we got an RFI table, which is the most complete database currently for FAST.

astro-ph.IM↗

arXiv2021

PAPooling: Graph-based Position Adaptive Aggregation of Local Geometry in Point Clouds

Fine-grained geometry, captured by aggregation of point features in local regions, is crucial for object recognition and scene understanding in point clouds. Nevertheless, existing preeminent point cloud backbones usually incorporate max/average pooling for local feature aggregation, which largely ignores points' positional distribution, leading to inadequate assembling of fine-grained structures. To mitigate this bottleneck, we present an efficient alternative to max pooling, Position Adaptive Pooling (PAPooling), that explicitly models spatial relations among local points using a novel graph representation, and aggregates features in a position adaptive manner, enabling position-sensitive representation of aggregated features. Specifically, PAPooling consists of two key steps, Graph Construction and Feature Aggregation, respectively in charge of constructing a graph with edges linking the center point with every neighboring point in a local region to map their relative positional information to channel-wise attentive weights, and adaptively aggregating local point features based on the generated weights through Graph Convolution Network (GCN). PAPooling is simple yet effective, and flexible enough to be ready to use for different popular backbones like PointNet++ and DGCNN, as a plug-andplay operator. Extensive experiments on various tasks ranging from 3D shape classification, part segmentation to scene segmentation well demonstrate that PAPooling can significantly improve predictive accuracy, while with minimal extra computational overhead. Code will be released.

cs.CV↗

arXiv2021

Search for Optimal Systolic Arrays: A Comprehensive Automated Exploration Framework and Lessons Learned

Systolic arrays have been widely used for accelerating HPC and deep learning applications. There is a plethora of previous works on the performance tuning of systolic arrays, but usually based on a number of oversimplified assumptions (e.g., only considering divisors for loop tiling, pruning based on off-chip data communication) to reduce the design space. In this paper, we present a comprehensive design space exploration tool named Odyssey for systolic array optimization. Odyssey does not rely on artificial assumptions to limit the design space, and yet it is highly efficient and scalable with a hybrid optimization technique. For example, for a 1024x1024x1024 matrix multiplication, it finds designs that reach 90% of the optimal performance in 5 seconds with a single CPU thread. Moreover, using Odyssey, we unveil and quantify the suboptimality introduced by multiple commonly used oversimplifications in prior studies for systolic array design space exploration. For example, Odyssey results show that limiting to divisors for loop tiling leads to a 39% performance loss, and pruning based on off-chip data movement results in a 45% performance loss. We applied Odyssey to explore the architecture trade-offs for matrix multiplication and convolutional neural network, providing inspiration into possible optimizations for these two applications.

cs.AR↗

arXiv2021

Jointly Learning Agent and Lane Information for Multimodal Trajectory Prediction

Predicting the plausible future trajectories of nearby agents is a core challenge for the safety of Autonomous Vehicles and it mainly depends on two external cues: the dynamic neighbor agents and static scene context. Recent approaches have made great progress in characterizing the two cues separately. However, they ignore the correlation between the two cues and most of them are difficult to achieve map-adaptive prediction. In this paper, we use lane as scene data and propose a staged network that Jointly learning Agent and Lane information for Multimodal Trajectory Prediction (JAL-MTP). JAL-MTP use a Social to Lane (S2L) module to jointly represent the static lane and the dynamic motion of the neighboring agents as instance-level lane, a Recurrent Lane Attention (RLA) mechanism for utilizing the instance-level lanes to predict the map-adaptive future trajectories and two selectors to identify the typical and reasonable trajectories. The experiments conducted on the public Argoverse dataset demonstrate that JAL-MTP significantly outperforms the existing models in both quantitative and qualitative.

cs.LG↗

arXiv2021

Charmless $B_s\to V S$ Decays in PQCD Approach

In this work, we investigate the $B_s\to V S$ decays in the perturbative QCD approach, where $V$ and $S$ denote the vector meson and scalar meson respectively. Based on the two-quark structure, considering two different scenarios for describing the scalar mesons, we calculate the branching fractions and the direct $CP$ asymmetries of all $B_s\to VS$ decays. Most branching fractions are predicted to be at $10^{-7}$ to $10^{-5}$, which could be measured in the LHCb and Belle-II experiments, especially for these color-allowed $B_s\to κ(800)(K_0^*(1430))K^*$ decays. It is found that the branching fractions of $B_s\to K_0^{*0}(1430)\bar{K}^{*0}$ and $B_s\to K_0^{*+}(1430)\bar{K}^{*-}$ are very sensitive to the scenarios, which can be used to determine whether $K_0^{*0}(1430)$ belongs to the ground state or the first excited state, if the data were available. We also note that some decays have large direct $CP$ asymmetries, some of which are also sensitive to the scenarios, such as the $B_s \to a_0^+(1450)K^{*-}$ and the $B_s\to f_0(1500) K^{*0}$ decays. Since the experimental measurements of $B_s\to VS$ decays are on the way, combined with the available data in the future, we expect the theoretical predictions will shed light on the structure of the scalar mesons.

hep-ph↗

arXiv2021

The Formation and Evolution of Massive Galaxies

The discovery of massive galaxies at high redshifts, especially the passive ones, poses a big challenge for the current standard galaxy formation models. Here we use the semi-analytic galaxy formation model developed by Henriques et al. to explore the formation and evolution of massive galaxies (MGs, stellar-mass $M_{*}> 10^{11}$ M$_{\odot}$). Different from previous works, we focus on the ones just formed (e.g. just reach $\simeq 10^{11}$ M$_{\odot}$). We find that most of the MGs are formed around $z=0.6$, with the earliest formation at $z>4$. Interestingly, although most of the MGs in the local Universe are passive, we find that only $13\%$ of the MGs are quenched at the formation time. Most of the quenched MGs at formation already hosts a very massive supermassive black hole (SMBH) which could power the very effective AGN feedback. For the star-forming MGs, the ones with more massive SMBH prefer to quench in shorter timescales; in particular, those with $M_{\textrm{SMBH}} > 10^{7.5}$ M$_{\odot}$ have a quenching timescale of $\sim 0.5$ Gyr and the characteristic $M_{\textrm{SMBH}}$ depends on the chosen stellar mass threshold in the definition of MGs as a result of their co-evolution. We also find that the "in-situ" star formation dominates the stellar mass growth of MGs until they are formed. Over the whole redshift range, we find the quiescent MGs prefer to stay in more massive dark matter halos, and have more massive SMBH and less cold gas masses. Our results provide a new angle on the whole life of the growth of MGs in the Universe.

astro-ph.GA↗

arXiv2021

Exact Landau Level Description of Geometry and Interaction in a Flatband

Flatbands appear in many condensed matter systems, such as in high magnetic fields, correlated materials and moire heterostructures. They are characterized by intrinsic geometric properties such as the Berry curvature and Fubini-Study metric. In general the band geometry is nonuniform in momentum space, making its influence on electron-electron interactions a difficult problem to understand analytically. In this work, we study this problem in a topological flatband of Chern number C=1 with the ideal properties that the Berry curvature is positive definite and fluctuates in sync with Fubini-Study metric. We derive an exact correspondence between such ideal flatbands and Landau levels by showing how the band geometry fluctuation in ideal flatbands gives raise to a new type of interaction in Landau levels which depends on the center-of-mass of two particles. We characterize such interaction by generalizing the usual Haldane pseudopotentials. This mapping gives exact zero-energy ground states for short-ranged repulsive generalized pseudopotentials in flatbands, in analogy to fractional quantum Hall systems. Driving the center-of-mass interactions beyond the repulsive regime leads to a dramatic reconstruction of the ground states towards gapless phases. The generalized pseudopotential could be a useful basis for future numerical studies.

cond-mat.mes-hall↗

arXiv2021

Staggered Pseudo Magnetic Field in Twisted Transition Metal Dichalcogenides: Physical Origin and Experimental Consequences

Strong magnetic fields profoundly affect the quantum physics of charged particles, as seen for example by the integer and fractionally quantized Hall effects, and the fractal `Hofstadter butterfly' spectrum of electrons in the presence of a periodic potential and a magnetic field. Intrinsic physics can lead to effects equivalent to those produced by an externally applied magnetic field. Examples include the `staggered flux' phases emerging in some theories of quantum spin liquids and the Chern insulator behavior of twisted bilayer graphene when valley symmetry is broken. In this paper we show that when two layers of the transition metal dichalcogenide material WSe2 are stacked at a small relative twist angle to form a Moire bilayer, the resulting low energy physics can be understood in terms of electrons moving in a strong and tunable staggered flux. We predict experimental consequences including sign reversals of the Hall coefficient on application of an interlayer potential and spin currents appearing at sample edges and interfaces.

cond-mat.mes-hall↗

arXiv2021

Meta Sequence Learning for Generating Adequate Question-Answer Pairs

Creating multiple-choice questions to assess reading comprehension of a given article involves generating question-answer pairs (QAPs) on the main points of the document. We present a learning scheme to generate adequate QAPs via meta-sequence representations of sentences. A meta sequence is a sequence of vectors comprising semantic and syntactic tags. In particular, we devise a scheme called MetaQA to learn meta sequences from training data to form pairs of a meta sequence for a declarative sentence (MD) and a corresponding interrogative sentence (MIs). On a given declarative sentence, a trained MetaQA model converts it to a meta sequence, finds a matched MD, and uses the corresponding MIs and the input sentence to generate QAPs. We implement MetaQA for the English language using semantic-role labeling, part-of-speech tagging, and named-entity recognition, and show that trained on a small dataset, MetaQA generates efficiently over the official SAT practice reading tests a large number of syntactically and semantically correct QAPs with over 97\% accuracy.

cs.CL↗

arXiv2021

Multi-Modal Multi-Instance Learning for Retinal Disease Recognition

This paper attacks an emerging challenge of multi-modal retinal disease recognition. Given a multi-modal case consisting of a color fundus photo (CFP) and an array of OCT B-scan images acquired during an eye examination, we aim to build a deep neural network that recognizes multiple vision-threatening diseases for the given case. As the diagnostic efficacy of CFP and OCT is disease-dependent, the network's ability of being both selective and interpretable is important. Moreover, as both data acquisition and manual labeling are extremely expensive in the medical domain, the network has to be relatively lightweight for learning from a limited set of labeled multi-modal samples. Prior art on retinal disease recognition focuses either on a single disease or on a single modality, leaving multi-modal fusion largely underexplored. We propose in this paper Multi-Modal Multi-Instance Learning (MM-MIL) for selectively fusing CFP and OCT modalities. Its lightweight architecture (as compared to current multi-head attention modules) makes it suited for learning from relatively small-sized datasets. For an effective use of MM-MIL, we propose to generate a pseudo sequence of CFPs by over sampling a given CFP. The benefits of this tactic include well balancing instances across modalities, increasing the resolution of the CFP input, and finding out regions of the CFP most relevant with respect to the final diagnosis. Extensive experiments on a real-world dataset consisting of 1,206 multi-modal cases from 1,193 eyes of 836 subjects demonstrate the viability of the proposed model.

cs.CV↗

arXiv2021

Fractional Quantum Hall States on CP2 Space

We study four-dimensional fractional quantum Hall states on CP2 geometry from microscopic approaches. While in 2d the standard Laughlin wave function, given by a power of Vandermonde determinant, admits a product representation in terms of the Jastrow factor, this is no longer true in higher dimensions. In 4d we can define two different types of Laughlin wavefunctions, the Determinant-Laughlin (Det-Laughlin) and Jastrow-Laughlin (Jas-Laughlin) states. We find that they are exactly annihilated by, respectively, two-particle and three-particle short ranged interacting Hamiltonians. We then mainly focus on the ground state, low energy excitations and the quasi-hole degeneracy of Det-Laughlin state. The quasi-hole degeneracy exhibits an anomalous counting, indicating the existence of multiple forms of quasi-hole wavefunctions. We argue that these are captured by the mathematical framework of the "commutative algebra of N-points in the plane". We also generalize the pseudopotential formalism to dimensions higher than two, by considering coherent state wavefunction of bound states. The microscopic wavefunctions and Hamiltonians studied in this work pave the way for systematic study of high dimensional topological phase of matter that is potentially realizable in cold atom and optical experiments.

cond-mat.mes-hall↗

arXiv2021

Discovery of Extra-Planar HI Clouds and a HI Tail in the M101 Galaxy Group with FAST

We present a new high-sensitivity HI observation toward nearby spiral galaxy M101 and its adjacent 2$^{\circ}\times$ 2$^{\circ}$ region using the Five-hundred-meter Aperture Spherical radio Telescope (FAST). From the observation, we detect a more extended and asymmetric HI disk around M101. While the HI velocity field within the M101's optical disk region is regular, indicating that the relatively strong disturbance occurs in its outer disk. Moreover, we identify three new HI clouds located on the southern edge of the M101's HI disk. The masses of the three HI clouds are 1.3$\times$10$^{7}$ $M_{\odot}$, 2.4$\times$10$^{7}$ $M_{\odot}$, and 2.0$\times$10$^{7}$ $M_{\odot}$, respectively. The HI clouds similar to dwarf companion NGC 5477 rotate with the HI disk of M101. Unlike the NGC 5477, they have no optical counterparts. Furthermore, we detect a new HI tail in the extended HI disk of M101. The HI tail detected gives a reliable evidence for M101 interaction with the dwarf companion NGC 5474. We argue that the extra-planar gas (three HI clouds) and the HI tail detected in the M101's disk may origin from a minor interaction with NGC 5474.

astro-ph.GA↗