arXiv subjects

Lu Wang

Publications and source records attributed to Lu Wang.

At least 361 records · Page 20Linked to original sources

arXiv2019

Full 3D+1 modelling of the tilted-pulse-front setups for single-cycle terahertz generation

The tilted-pulse-front setup utilizing a diffraction grating is one of the most successful methods to generate single- to few-cycle terahertz pulses. However, the generated terahertz pulses have a large spatial inhomogeneity, due to the noncollinear phase matching condition and the asymmetry of the prism-shaped nonlinear crystal geometry, especially when pushing for high optical-to-terahertz conversion efficiency. A 3D+1 (x,y,z,t) numerical model is necessary in order to fully investigate the terahertz generation problem in the tilted-pulse-front scheme. We compare in detail the differences between 1D+1, 2D+1 and 3D+1 models. The simulations show that the size of the optical beam in the pulse-front-tilt plane sensitively affects the spatio-temporal properties of the terahertz electric field. The terahertz electric field is found to have a strong spatial dependence such that a few-cycle pulse is only generated near the apex of the prism. The part of the beam farther from the apex contains a large fraction of the energy but has a waveform that deviates from a few-cycle. This strong spatial dependence must be accounted for when using the terahertz pulses for strong-field physics and carrier-envelope-phase sensitive experiments such as terahertz acceleration, coherent control of antiferromagnetic spin waves and terahertz high-harmonic generation.

physics.optics↗

arXiv2019

Infinite-horizon Off-Policy Policy Evaluation with Multiple Behavior Policies

We consider off-policy policy evaluation when the trajectory data are generated by multiple behavior policies. Recent work has shown the key role played by the state or state-action stationary distribution corrections in the infinite horizon context for off-policy policy evaluation. We propose estimated mixture policy (EMP), a novel class of partially policy-agnostic methods to accurately estimate those quantities. With careful analysis, we show that EMP gives rise to estimates with reduced variance for estimating the state stationary distribution correction while it also offers a useful induction bias for estimating the state-action stationary distribution correction. In extensive experiments with both continuous and discrete environments, we demonstrate that our algorithm offers significantly improved accuracy compared to the state-of-the-art methods.

cs.LG↗

arXiv2019

Learning Robust Representations with Graph Denoising Policy Network

Graph representation learning, aiming to learn low-dimensional representations which capture the geometric dependencies between nodes in the original graph, has gained increasing popularity in a variety of graph analysis tasks, including node classification and link prediction. Existing representation learning methods based on graph neural networks and their variants rely on the aggregation of neighborhood information, which makes it sensitive to noises in the graph. In this paper, we propose Graph Denoising Policy Network (short for GDPNet) to learn robust representations from noisy graph data through reinforcement learning. GDPNet first selects signal neighborhoods for each node, and then aggregates the information from the selected neighborhoods to learn node representations for the down-stream tasks. Specifically, in the signal neighborhood selection phase, GDPNet optimizes the neighborhood for each target node by formulating the process of removing noisy neighborhoods as a Markov decision process and learning a policy with task-specific rewards received from the representation learning phase. In the representation learning phase, GDPNet aggregates features from signal neighbors to generate node representations for down-stream tasks, and provides task-specific rewards to the signal neighbor selection phase. These two phases are jointly trained to select optimal sets of neighbors for target nodes with maximum cumulative task-specific rewards, and to learn robust representations for nodes. Experimental results on node classification task demonstrate the effectiveness of GDNet, outperforming the state-of-the-art graph representation learning methods on several well-studied datasets. Additionally, GDPNet is mathematically equivalent to solving the submodular maximizing problem, which theoretically guarantees the best approximation to the optimal solution with GDPNet.

cs.LG↗

arXiv2019

Semi-Supervised Learning for Neural Keyphrase Generation

We study the problem of generating keyphrases that summarize the key points for a given document. While sequence-to-sequence (seq2seq) models have achieved remarkable performance on this task (Meng et al., 2017), model training often relies on large amounts of labeled data, which is only applicable to resource-rich domains. In this paper, we propose semi-supervised keyphrase generation methods by leveraging both labeled data and large-scale unlabeled samples for learning. Two strategies are proposed. First, unlabeled documents are first tagged with synthetic keyphrases obtained from unsupervised keyphrase extraction methods or a selflearning algorithm, and then combined with labeled samples for training. Furthermore, we investigate a multi-task learning framework to jointly learn to generate keyphrases as well as the titles of the articles. Experimental results show that our semi-supervised learning-based methods outperform a state-of-the-art model trained with labeled data only.

cs.CL↗

arXiv2019

In Plain Sight: Media Bias Through the Lens of Factual Reporting

The increasing prevalence of political bias in news media calls for greater public awareness of it, as well as robust methods for its detection. While prior work in NLP has primarily focused on the lexical bias captured by linguistic attributes such as word choice and syntax, other types of bias stem from the actual content selected for inclusion in the text. In this work, we investigate the effects of informational bias: factual content that can nevertheless be deployed to sway reader opinion. We first produce a new dataset, BASIL, of 300 news articles annotated with 1,727 bias spans and find evidence that informational bias appears in news articles more frequently than lexical bias. We further study our annotations to observe how informational bias surfaces in news articles by different media outlets. Lastly, a baseline model for informational bias prediction is presented by fine-tuning BERT on our labeled data, indicating the challenges of the task and future directions.

cs.CL↗

arXiv2019

An Entity-Driven Framework for Abstractive Summarization

Abstractive summarization systems aim to produce more coherent and concise summaries than their extractive counterparts. Popular neural models have achieved impressive results for single-document summarization, yet their outputs are often incoherent and unfaithful to the input. In this paper, we introduce SENECA, a novel System for ENtity-drivEn Coherent Abstractive summarization framework that leverages entity information to generate informative and coherent abstracts. Our framework takes a two-step approach: (1) an entity-aware content selection module first identifies salient sentences from the input, then (2) an abstract generation module conducts cross-sentence information compression and abstraction to generate the final summary, which is trained with rewards to promote coherence, conciseness, and clarity. The two components are further connected using reinforcement learning. Automatic evaluation shows that our model significantly outperforms previous state-of-the-art on ROUGE and our proposed coherence measures on New York Times and CNN/Daily Mail datasets. Human judges further rate our system summaries as more informative and coherent than those by popular summarization models.

cs.CL↗

arXiv2019

Sentence-Level Content Planning and Style Specification for Neural Text Generation

Building effective text generation systems requires three critical components: content selection, text planning, and surface realization, and traditionally they are tackled as separate problems. Recent all-in-one style neural generation models have made impressive progress, yet they often produce outputs that are incoherent and unfaithful to the input. To address these issues, we present an end-to-end trained two-step generation model, where a sentence-level content planner first decides on the keyphrases to cover as well as a desired language style, followed by a surface realization decoder that generates relevant and coherent text. For experiments, we consider three tasks from domains with diverse topics and varying language styles: persuasive argument construction from Reddit, paragraph generation for normal and simple versions of Wikipedia, and abstract generation for scientific articles. Automatic evaluation shows that our system can significantly outperform competitive comparisons. Human judges further rate our system generated text as more fluent and correct, compared to the generations by its variants that do not consider language style.

cs.CL↗

arXiv2019

Learning Signal Subgraphs from Longitudinal Brain Networks with Symmetric Bilinear Logistic Regression

Modern neuroimaging technologies, combined with state-of-the-art data processing pipelines, have made it possible to collect longitudinal observations of an individual's brain connectome at different ages. It is of substantial scientific interest to study how brain connectivity varies over time in relation to human cognitive traits. In brain connectomics, the structural brain network for an individual corresponds to a set of interconnections among brain regions. We propose a symmetric bilinear logistic regression to learn a set of small subgraphs relevant to a binary outcome from longitudinal brain networks as well as estimating the time effects of the subgraphs. We enforce the extracted signal subgraphs to have clique structure which has appealing interpretations as they can be related to neurological circuits. The time effect of each signal subgraph reflects how its predictive effect on the outcome varies over time, which may improve our understanding of interactions between the aging of brain structure and neurological disorders. Application of this method on longitudinal brain connectomics and cognitive capacity data shows interesting discovery of relevant interconnections among a small set of brain regions in frontal and temporal lobes with better predictive performance than competitors.

stat.AP↗

arXiv2019

Jointly Learning Semantic Parser and Natural Language Generator via Dual Information Maximization

Semantic parsing aims to transform natural language (NL) utterances into formal meaning representations (MRs), whereas an NL generator achieves the reverse: producing a NL description for some given MRs. Despite this intrinsic connection, the two tasks are often studied separately in prior work. In this paper, we model the duality of these two tasks via a joint learning framework, and demonstrate its effectiveness of boosting the performance on both tasks. Concretely, we propose a novel method of dual information maximization (DIM) to regularize the learning process, where DIM empirically maximizes the variational lower bounds of expected joint distributions of NL and MRs. We further extend DIM to a semi-supervision setup (SemiDIM), which leverages unlabeled data of both tasks. Experiments on three datasets of dialogue management and code generation (and summarization) show that performance on both semantic parsing and NL generation can be consistently improved by DIM, in both supervised and semi-supervised setups.

cs.CL↗

arXiv2019

BIGPATENT: A Large-Scale Dataset for Abstractive and Coherent Summarization

Most existing text summarization datasets are compiled from the news domain, where summaries have a flattened discourse structure. In such datasets, summary-worthy content often appears in the beginning of input articles. Moreover, large segments from input articles are present verbatim in their respective summaries. These issues impede the learning and evaluation of systems that can understand an article's global content structure as well as produce abstractive summaries with high compression ratio. In this work, we present a novel dataset, BIGPATENT, consisting of 1.3 million records of U.S. patent documents along with human written abstractive summaries. Compared to existing summarization datasets, BIGPATENT has the following properties: i) summaries contain a richer discourse structure with more recurring entities, ii) salient content is evenly distributed in the input, and iii) lesser and shorter extractive fragments are present in the summaries. Finally, we train and evaluate baselines and popular learning models on BIGPATENT to shed light on new challenges and motivate future directions for summarization research.

cs.CL↗

arXiv2019

Evaluating the Robustness of Nearest Neighbor Classifiers: A Primal-Dual Perspective

We study the problem of computing the minimum adversarial perturbation of the Nearest Neighbor (NN) classifiers. Previous attempts either conduct attacks on continuous approximations of NN models or search for the perturbation by some heuristic methods. In this paper, we propose the first algorithm that is able to compute the minimum adversarial perturbation. The main idea is to formulate the problem as a list of convex quadratic programming (QP) problems that can be efficiently solved by the proposed algorithms for 1-NN models. Furthermore, we show that dual solutions for these QP problems could give us a valid lower bound of the adversarial perturbation that can be used for formal robustness verification, giving us a nice view of attack/verification for NN models. For $K$-NN models with larger $K$, we show that the same formulation can help us efficiently compute the upper and lower bounds of the minimum adversarial perturbation, which can be used for attack and verification.

cs.LG↗

arXiv2019

Neural Keyphrase Generation via Reinforcement Learning with Adaptive Rewards

Generating keyphrases that summarize the main points of a document is a fundamental task in natural language processing. Although existing generative models are capable of predicting multiple keyphrases for an input document as well as determining the number of keyphrases to generate, they still suffer from the problem of generating too few keyphrases. To address this problem, we propose a reinforcement learning (RL) approach for keyphrase generation, with an adaptive reward function that encourages a model to generate both sufficient and accurate keyphrases. Furthermore, we introduce a new evaluation method that incorporates name variations of the ground-truth keyphrases using the Wikipedia knowledge base. Thus, our evaluation method can more robustly evaluate the quality of predicted keyphrases. Extensive experiments on five real-world datasets of different scales demonstrate that our RL approach consistently and significantly improves the performance of the state-of-the-art generative models with both conventional and new evaluation methods.

cs.CL↗

arXiv2019

Argument Generation with Retrieval, Planning, and Realization

Automatic argument generation is an appealing but challenging task. In this paper, we study the specific problem of counter-argument generation, and present a novel framework, CANDELA. It consists of a powerful retrieval system and a novel two-step generation model, where a text planning decoder first decides on the main talking points and a proper language style for each sentence, then a content realization decoder reflects the decisions and constructs an informative paragraph-level argument. Furthermore, our generation model is empowered by a retrieval system indexed with 12 million articles collected from Wikipedia and popular English news media, which provides access to high-quality content with diversity. Automatic evaluation on a large-scale dataset collected from Reddit shows that our model yields significantly higher BLEU, ROUGE, and METEOR scores than the state-of-the-art and non-trivial comparisons. Human evaluation further indicates that our system arguments are more appropriate for refutation and richer in content.

cs.CL↗

arXiv2019

Joint Effects of Context and User History for Predicting Online Conversation Re-entries

As the online world continues its exponential growth, interpersonal communication has come to play an increasingly central role in opinion formation and change. In order to help users better engage with each other online, we study a challenging problem of re-entry prediction foreseeing whether a user will come back to a conversation they once participated in. We hypothesize that both the context of the ongoing conversations and the users' previous chatting history will affect their continued interests in future engagement. Specifically, we propose a neural framework with three main layers, each modeling context, user history, and interactions between them, to explore how the conversation context and user chatting history jointly result in their re-entry behavior. We experiment with two large-scale datasets collected from Twitter and Reddit. Results show that our proposed framework with bi-attention achieves an F1 score of 61.1 on Twitter conversations, outperforming the state-of-the-art methods from previous work.

cs.CL↗

arXiv2019

Efficient Electrocatalytic Reduction of CO2 by Nitrogen-Doped Nanoporous Carbon-Carbon Nanotube Membranes - A Step Towards the Electrochemical CO2 Refinery

The search for earth abundant, efficient and stable electrocatalysts that can enable the chemical reduction of CO2 to value-added chemicals and fuels at an industrially relevant scale, is a high priority for the development of a global network of renewable energy conversion and storage systems that can meaningfully impact greenhouse gas induced climate change. Here we introduce a straightforward, low cost, scalable and technologically relevant method to manufacture an all-carbon, electroactive, nitrogen-doped nanoporous carbon-carbon nanotube composite membrane, dubbed "HNCM-CNT". The membrane is demonstrated to function as a binder-free, high-performance electrode for the electrocatalytic reduction of CO2 to formate. The Faradaic efficiency for the production of formate is 81%. Furthermore, the robust structural and electrochemical properties of the membrane endow it with excellent long-term stability.

physics.chem-ph↗

arXiv2019

Ambient Electro-Synthesis of Ammonia - Electrode Porosity and Composition Engineering

Ammonia, key precursor for fertilizer production, convenient hydrogen carrier and emerging clean fuel, plays a pivotal role in sustaining life on earth. Currently, the main route for NH3 synthesis is via the heterogeneous catalytic Haber-Bosch process (N2+3H2 - 2NH3), which proceeds under extreme conditions of temperature and pressure with a very large carbon footprint. Herein we report that a pristine nitrogen-doped nanoporous graphitic carbon membrane (NCM) can electrochemically convert N2 into NH3 in an aqueous acidic solution under ambient conditions. The Faradaic efficiency and rate of production of NH3 on the NCM electrode reach 5.2% and 0.08 g m-2 h-1, respectively. After functionalization of the NCM with Au nanoparticles (Au NPs) these performance metrics are dramatically enhanced to 22% and 0.36 g m-2 h-1, respectively. These efficiencies and rates for the production of NH3 at room temperature and atmospheric pressure are unprecedented. As this system offers the potential to be scaled to industrial proportions there is a high likelihood it might displace the century old Haber-Bosch process.

physics.chem-ph↗

arXiv2019

Argument Mining for Understanding Peer Reviews

Peer-review plays a critical role in the scientific writing and publication ecosystem. To assess the efficiency and efficacy of the reviewing process, one essential element is to understand and evaluate the reviews themselves. In this work, we study the content and structure of peer reviews under the argument mining framework, through automatically detecting (1) argumentative propositions put forward by reviewers, and (2) their types (e.g., evaluating the work or making suggestions for improvement). We first collect 14.2K reviews from major machine learning and natural language processing venues. 400 reviews are annotated with 10,386 propositions and corresponding types of Evaluation, Request, Fact, Reference, or Quote. We then train state-of-the-art proposition segmentation and classification models on the data to evaluate their utilities and identify new challenges for this new domain, motivating future directions for argument mining. Further experiments show that proposition usage varies across venues in amount, type, and topic.

cs.CL↗

arXiv2019

IvaNet: Learning to jointly detect and segment objets with the help of Local Top-Down Modules

Driven by Convolutional Neural Networks, object detection and semantic segmentation have gained significant improvements. However, existing methods on the basis of a full top-down module have limited robustness in handling those two tasks simultaneously. To this end, we present a joint multi-task framework, termed IvaNet. Different from existing methods, our IvaNet backwards abstract semantic information from higher layers to augment lower layers using local top-down modules. The comparisons against some counterparts on the PASCAL VOC and MS COCO datasets demonstrate the functionality of IvaNet.

cs.CV↗