Search arXiv⌕ Search

arXiv subjects

Yue Yu

Publications and source records attributed to Yue Yu.

At least 415 records · Page 23Linked to original sources

Proportional-Integral Projected Gradient Method for Model Predictive Control

Recently there has been an increasing interest in primal-dual methods for model predictive control (MPC), which require minimizing the (augmented) Lagrangian at each iteration. We propose a novel first order primal-dual method, termed \emph{proportional-integral projected gradient method}, for MPC where the underlying finite horizon optimal control problem has both state and input constraints. Instead of minimizing the (augmented) Lagrangian, each iteration of our method only computes a single projection onto the state and input constraint set. Our method ensures that, along a sequence of averaged iterates, both the distance to optimum and the constraint violation converge to zero at a rate of \(O(1/k)\) if the objective function is convex, where \(k\) is the iteration number. If the objective function is strongly convex, this rate can be improved to \(O(1/k^2)\) for the distance to optimum and \(O(1/k^3)\) for the constraint violation. We compare our method against existing methods via a trajectory-planning example with convexified keep-out-zone constraints.

math.OC↗

Data-driven learning of nonlocal models: from high-fidelity simulations to constitutive laws

We show that machine learning can improve the accuracy of simulations of stress waves in one-dimensional composite materials. We propose a data-driven technique to learn nonlocal constitutive laws for stress wave propagation models. The method is an optimization-based technique in which the nonlocal kernel function is approximated via Bernstein polynomials. The kernel, including both its functional form and parameters, is derived so that when used in a nonlocal solver, it generates solutions that closely match high-fidelity data. The optimal kernel therefore acts as a homogenized nonlocal continuum model that accurately reproduces wave motion in a smaller-scale, more detailed model that can include multiple materials. We apply this technique to wave propagation within a heterogeneous bar with a periodic microstructure. Several one-dimensional numerical tests illustrate the accuracy of our algorithm. The optimal kernel is demonstrated to reproduce high-fidelity data for a composite material in applications that are substantially different from the problems used as training data.

cs.LG↗

DAGs with No Fears: A Closer Look at Continuous Optimization for Learning Bayesian Networks

This paper re-examines a continuous optimization framework dubbed NOTEARS for learning Bayesian networks. We first generalize existing algebraic characterizations of acyclicity to a class of matrix polynomials. Next, focusing on a one-parameter-per-edge setting, it is shown that the Karush-Kuhn-Tucker (KKT) optimality conditions for the NOTEARS formulation cannot be satisfied except in a trivial case, which explains a behavior of the associated algorithm. We then derive the KKT conditions for an equivalent reformulation, show that they are indeed necessary, and relate them to explicit constraints that certain edges be absent from the graph. If the score function is convex, these KKT conditions are also sufficient for local minimality despite the non-convexity of the constraint. Informed by the KKT conditions, a local search post-processing algorithm is proposed and shown to substantially and universally improve the structural Hamming distance of all tested algorithms, typically by a factor of 2 or more. Some combinations with local search are both more accurate and more efficient than the original NOTEARS.

cs.LG↗

MCMH: Learning Multi-Chain Multi-Hop Rules for Knowledge Graph Reasoning

Multi-hop reasoning approaches over knowledge graphs infer a missing relationship between entities with a multi-hop rule, which corresponds to a chain of relationships. We extend existing works to consider a generalized form of multi-hop rules, where each rule is a set of relation chains. To learn such generalized rules efficiently, we propose a two-step approach that first selects a small set of relation chains as a rule and then evaluates the confidence of the target relationship by jointly scoring the selected chains. A game-theoretical framework is proposed to this end to simultaneously optimize the rule selection and prediction steps. Empirical results show that our multi-chain multi-hop (MCMH) rules result in superior results compared to the standard single-chain approaches, justifying both our formulation of generalized rules and the effectiveness of the proposed learning framework.

cs.CL↗

SeqMix: Augmenting Active Sequence Labeling via Sequence Mixup

Active learning is an important technique for low-resource sequence labeling tasks. However, current active sequence labeling methods use the queried samples alone in each iteration, which is an inefficient way of leveraging human annotations. We propose a simple but effective data augmentation method to improve the label efficiency of active sequence labeling. Our method, SeqMix, simply augments the queried samples by generating extra labeled sequences in each iteration. The key difficulty is to generate plausible sequences along with token-level labels. In SeqMix, we address this challenge by performing mixup for both sequences and token-level labels of the queried samples. Furthermore, we design a discriminator during sequence mixup, which judges whether the generated sequences are plausible or not. Our experiments on Named Entity Recognition and Event Detection tasks show that SeqMix can improve the standard active sequence labeling method by $2.27\%$--$3.75\%$ in terms of $F_1$ scores. The code and data for SeqMix can be found at https://github.com/rz-zhang/SeqMix

cs.CL↗

BOND: BERT-Assisted Open-Domain Named Entity Recognition with Distant Supervision

We study the open-domain named entity recognition (NER) problem under distant supervision. The distant supervision, though does not require large amounts of manual annotations, yields highly incomplete and noisy distant labels via external knowledge bases. To address this challenge, we propose a new computational framework -- BOND, which leverages the power of pre-trained language models (e.g., BERT and RoBERTa) to improve the prediction performance of NER models. Specifically, we propose a two-stage training algorithm: In the first stage, we adapt the pre-trained language model to the NER tasks using the distant labels, which can significantly improve the recall and precision; In the second stage, we drop the distant labels, and propose a self-training approach to further improve the model performance. Thorough experiments on 5 benchmark datasets demonstrate the superiority of BOND over existing distantly supervised NER methods. The code and distantly labeled data have been released in https://github.com/cliang1453/BOND.

cs.CL↗

STEAM: Self-Supervised Taxonomy Expansion with Mini-Paths

Taxonomies are important knowledge ontologies that underpin numerous applications on a daily basis, but many taxonomies used in practice suffer from the low coverage issue. We study the taxonomy expansion problem, which aims to expand existing taxonomies with new concept terms. We propose a self-supervised taxonomy expansion model named STEAM, which leverages natural supervision in the existing taxonomy for expansion. To generate natural self-supervision signals, STEAM samples mini-paths from the existing taxonomy, and formulates a node attachment prediction task between anchor mini-paths and query terms. To solve the node attachment task, it learns feature representations for query-anchor pairs from multiple views and performs multi-view co-training for prediction. Extensive experiments show that STEAM outperforms state-of-the-art methods for taxonomy expansion by 11.6\% in accuracy and 7.0\% in mean reciprocal rank on three public benchmarks. The implementation of STEAM can be found at \url{https://github.com/yueyu1030/STEAM}.

cs.CL↗

$T_c$ and Pauli limited critical field of $\text{Sr}_2\text{Ru}\text{O}_4$: uniaxial strain dependence

Variations of critical temperature $T_c$ and in-plane critical field $H_{c2}$ of $\text{Sr}_2\text{Ru}\text{O}_4$ under uniaxial stress have recently been reported. We compare the strain dependence of $T_c$ and $H_{c2}$ in various pairing channels ($d$-wave, extended s-wave and $p$-wave) with the experimental observations, by studying a three-band tight-binding model that includes effects of spin-orbit and Zeeman couplings and a separable pairing interaction. Our study helps narrow down the possibility of pairing channels. The importance of the multi-band nature of $\text{Sr}_2\text{Ru}\text{O}_4$ is also highlighted.

cond-mat.supr-con↗

Data-driven learning of robust nonlocal physics from high-fidelity synthetic data

A key challenge to nonlocal models is the analytical complexity of deriving them from first principles, and frequently their use is justified a posteriori. In this work we extract nonlocal models from data, circumventing these challenges and providing data-driven justification for the resulting model form. Extracting provably robust data-driven surrogates is a major challenge for machine learning (ML) approaches, due to nonlinearities and lack of convexity. Our scheme allows extraction of provably invertible nonlocal models whose kernels may be partially negative. To achieve this, based on established nonlocal theory, we embed in our algorithm sufficient conditions on the non-positive part of the kernel that guarantee well-posedness of the learnt operator. These conditions are imposed as inequality constraints and ensure that models are robust, even in small-data regimes. We demonstrate this workflow for a range of applications, including reproduction of manufactured nonlocal kernels; numerical homogenization of Darcy flow associated with a heterogeneous periodic microstructure; nonlocal approximation to high-order local transport phenomena; and approximation of globally supported fractional diffusion operators by truncated kernels.

math.OC↗

Three Jahn-Teller states of matter in the spin-crossover system Mn(taa)

Three high-spin phases recently discovered in the spin-crossover system Mn(taa) are identified through analysis by a combination of first-principles calculations and Monte Carlo simulation as a low-temperature Jahn-Teller ordered (solid) phase, an intermediate-temperature dynamically correlated (liquid) phase, and an uncorrelated (gas) phase. In particular, the Jahn-Teller liquid phase arises from competition between mixing with low-spin impurities, which drive the disorder, and inter-molecular strain interactions. The latter are a key factor in both the spin-crossover phase transition and the magnetoelectric coupling. Jahn-Teller liquids may exist in other spin-crossover materials and materials that have multiple equivalent Jahn-Teller axes.

cond-mat.mtrl-sci↗

Urban Anomaly Analytics: Description, Detection, and Prediction

Urban anomalies may result in loss of life or property if not handled properly. Automatically alerting anomalies in their early stage or even predicting anomalies before happening are of great value for populations. Recently, data-driven urban anomaly analysis frameworks have been forming, which utilize urban big data and machine learning algorithms to detect and predict urban anomalies automatically. In this survey, we make a comprehensive review of the state-of-the-art research on urban anomaly analytics. We first give an overview of four main types of urban anomalies, traffic anomaly, unexpected crowds, environment anomaly, and individual anomaly. Next, we summarize various types of urban datasets obtained from diverse devices, i.e., trajectory, trip records, CDRs, urban sensors, event records, environment data, social media and surveillance cameras. Subsequently, a comprehensive survey of issues on detecting and predicting techniques for urban anomalies is presented. Finally, research challenges and open problems as discussed.

cs.SI↗

Phases of frustrated quantum antiferromagnets on the square and triangular lattices

We analyze the zero temperature phase diagrams of the spin S quantum antiferromagnet on square and triangular lattices with competing nearest and next-nearest exchange interactions as well as biquadratic couplings. We approach the problem from the large S limit. Our primary focus is on determining the extent to which the existence and character of any quantum disordered phases can be inferred from this approach.

cond-mat.str-el↗

Topological superconductor from superconducting topological surface states and fault-tolerant quantum computing

The chiral $p$-wave superconductor/superfluid in two dimensions (2D) is the simplest and most robust system for topological quantum computation . Candidates for such topological superconductors/superfluids in nature are very rare. A widely believed chiral $p$-wave superfluid is the Moore-Read state in the $ν=\frac{5}2$ fractional quantum Hall effect, although experimental evidence are not yet conclusive. Experimental realizations of chiral $p$-wave superconductors using quantum anomalous Hall insulator-superconductor hybrid structures have been controversial. Here we report a new mechanism for realizing 2D chiral $p$-wave superconductors on the surface of 3D $s$-wave superconductors that have a topological band structure and support superconducting topological surface states (SC-TSS), such as the iron-based superconductor Fe(Te,Se). We find that tunneling and pairing between the SC-TSS on the top and bottom surfaces in a thin film or between two opposing surfaces of two such superconductors can produce an emergent 2D time-reversal symmetry breaking chiral topological superconductor. The topologically protected anyonic vortices with Majorana zero modes as well as the chiral Majorana fermion edge modes can be used as a platform for more advantageous non-abelian braiding operations. We propose a novel device for the CNOT gate with six chiral Majorana fermion edge modes, which paves the way for fault-tolerant universal quantum computing.

cond-mat.supr-con↗

RC Circuits based Distributed Conditional Gradient Method

We consider distributed optimization on undirected connected graphs. We propose a novel distributed conditional gradient method with (O(1/\sqrt{k})) convergence. Compared with existing methods, each iteration of our method uses both communication and linear minimization step only once rather than multiple times. We further extend our results to cases with composite local constraints. We demonstrate our results via examples on distributed matrix completion problem.

math.OC↗

SPAN: A Stochastic Projected Approximate Newton Method

Second-order optimization methods have desirable convergence properties. However, the exact Newton method requires expensive computation for the Hessian and its inverse. In this paper, we propose SPAN, a novel approximate and fast Newton method. SPAN computes the inverse of the Hessian matrix via low-rank approximation and stochastic Hessian-vector products. Our experiments on multiple benchmark datasets demonstrate that SPAN outperforms existing first-order and second-order optimization methods in terms of the convergence wall-clock time. Furthermore, we provide a theoretical analysis of the per-iteration complexity, the approximation error, and the convergence rate. Both the theoretical analysis and experimental results show that our proposed method achieves a better trade-off between the convergence rate and the per-iteration efficiency.

math.OC↗

RLC Circuits based Distributed Mirror Descent Method

We consider distributed optimization with smooth convex objective functions defined on an undirected connected graph. Inspired by mirror descent mehod and RLC circuits, we propose a novel distributed mirror descent method. Compared with mirror-prox method, our algorithm achieves the same \(\mathcal{O}(1/k)\) iteration complexity with only half the computation cost per iteration. We further extend our results to cases where a) gradients are corrupted by stochastic noise, and b) objective function is composed of both smooth and non-smooth terms. We demonstrate our theoretical results via numerical experiments.

math.OC↗

Quantum chaos associated with emergent ergosurface in transition layer between type-I and type-II Weyl semimetals

We present emergent ergosurfaces (ES) in a transition layer between type-I and type-II Weyl semimetals (WSMs). The Hawking temperature defined by the surface gravity at the acoustic event horizon which coincides with the ES when the tangent velocity $v_{\parallel}$ is small is in a measurable interval. On the type-II WSM side, i.e., inside the {ES when $v_{\parallel}$ is large}, the motion of the quasiparticles may be chaotic {after} a critical surface as they are governed by an effective inverted oscillator potential induced by the mismatch between the type-I and type-II Weyl nodes. In a relevant lattice model, we calculate out of time ordered correlators (OTOCs). We find that the OTOCs are fast scrambling with a quantum Lyapunov exponent in high temperature and the scrambling is saturated after the Ehrenfest time. This confirms the quantum chaotic behavior.

cond-mat.mes-hall↗

A review of Local-to-Nonlocal coupling methods in nonlocal diffusion and nonlocal mechanics

Local-to-Nonlocal (LtN) coupling refers to a class of methods aimed at combining nonlocal and local modeling descriptions of a given system into a unified coupled representation. This allows to consolidate the accuracy of nonlocal models with the computational expediency of their local counterparts, while often simultaneously removing additional nonlocal modeling issues such as surface effects. The number and variety of proposed LtN coupling approaches have significantly grown in recent year, yet the field of LtN coupling continues to grow and still has open challenges. This review provides an overview of the state-of-the-art of LtN coupling in the context of nonlocal diffusion and nonlocal mechanics, specifically peridynamics. We present a classification of LtN coupling methods and discuss common features and challenges. The goal of this review is not to provide a preferred way to address LtN coupling but to present a broad perspective of the field, which would serve as guidance for practitioners in the selection of appropriate LtN coupling methods based on the characteristics and needs of the problem under consideration.

math.AP↗