arXiv subjects

Zhiyuan Yao

Publications and source records attributed to Zhiyuan Yao.

67 records · Page 4Linked to original sources

arXiv2022

Towards Modern Card Games with Large-Scale Action Spaces Through Action Representation

Axie infinity is a complicated card game with a huge-scale action space. This makes it difficult to solve this challenge using generic Reinforcement Learning (RL) algorithms. We propose a hybrid RL framework to learn action representations and game strategies. To avoid evaluating every action in the large feasible action set, our method evaluates actions in a fixed-size set which is determined using action representations. We compare the performance of our method with the other two baseline methods in terms of their sample efficiency and the winning rates of the trained models. We empirically show that our method achieves an overall best winning rate and the best sample efficiency among the three methods.

cs.AI↗

arXiv2021

Noise Enhanced Neural Networks for Analytic Continuation

Analytic continuation maps imaginary-time Green's functions obtained by various theoretical/numerical methods to real-time response functions that can be directly compared with experiments. Analytic continuation is an important bridge between many-body theories and experiments but is also a challenging problem because such mappings are ill-conditioned. In this work, we develop a neural network-based method for this problem. The training data is generated either using synthetic Gaussian-type spectral functions or from exactly solvable models where the analytic continuation can be obtained analytically. Then, we applied the trained neural network to the testing data, either with synthetic noise or intrinsic noise in Monte Carlo simulations. We conclude that the best performance is always achieved when a proper amount of noise is added to the training data. Moreover, our method can successfully capture multi-peak structure in the resulting response function for the cases with the best performance. The method can be combined with Monte Carlo simulations to compare with experiments on real-time dynamics.

physics.comp-ph↗

arXiv2021

Charon: Load-Aware Load-Balancing in P4

Load-Balancers play an important role in data centers as they distribute network flows across application servers and guarantee per-connection consistency. It is hard however to make fair load balancing decisions so that all resources are efficiently occupied yet not overloaded. Tracking connection states allows to infer server load states and make informed decisions, but at the cost of additional memory space consumption. This makes it hard to implement on programmable hardware, which has constrained memory but offers line-rate performance. This paper presents Charon, a stateless load-aware load balancer that has line-rate performance implemented in P4-NetFPGA. Charon passively collects load states from application servers and employs the power-of-2-choices scheme to make data-driven load balancing decisions and improve resource utilization. Perconnection consistency is preserved statelessly by encoding server ID in a covert channel. The prototype design and implementation details are described in this paper. Simulation results show performance gains in terms of load distribution fairness, quality of service, throughput and processing latency.

cs.AR↗

arXiv2021

Reinforced Workload Distribution Fairness

Network load balancers are central components in data centers, that distributes workloads across multiple servers and thereby contribute to offering scalable services. However, when load balancers operate in dynamic environments with limited monitoring of application server loads, they rely on heuristic algorithms that require manual configurations for fairness and performance. To alleviate that, this paper proposes a distributed asynchronous reinforcement learning mechanism to-with no active load balancer state monitoring and limited network observations-improve the fairness of the workload distribution achieved by a load balancer. The performance of proposed mechanism is evaluated and compared with stateof-the-art load balancing algorithms in a simulator, under configurations with progressively increasing complexities. Preliminary results show promise in RLbased load balancing algorithms, and identify additional challenges and future research directions, including reward function design and model scalability.

cs.DC↗

arXiv2021

Towards Intelligent Load Balancing in Data Centers

Network load balancers are important components in data centers to provide scalable services. Workload distribution algorithms are based on heuristics, e.g., Equal-Cost Multi-Path (ECMP), Weighted-Cost Multi-Path (WCMP) or naive machine learning (ML) algorithms, e.g., ridge regression. Advanced ML-based approaches help achieve performance gain in different networking and system problems. However, it is challenging to apply ML algorithms on networking problems in real-life systems. It requires domain knowledge to collect features from low-latency, high-throughput, and scalable networking systems, which are dynamic and heterogenous. This paper proposes Aquarius to bridge the gap between ML and networking systems and demonstrates its usage in the context of network load balancers. This paper demonstrates its ability of conducting both offline data analysis and online model deployment in realistic systems. The results show that the ML model trained and deployed using Aquarius improves load balancing performance yet they also reveals more challenges to be resolved to apply ML for networking systems.

cs.DC↗

arXiv2021

Do current X-ray observations capture most of the black-hole accretion at high redshifts?

The cosmic black hole accretion density (BHAD) is critical for our understanding of the formation and evolution of supermassive black holes (BHs). However, at high redshifts ($z>3$), X-ray observations report BHADs significantly ($\sim 10$ times) lower than those predicted by cosmological simulations. It is therefore paramount to constrain the high-$z$ BHAD using independent methods other than direct X-ray detections. The recently established relation between star formation rate and BH accretion rate among bulge-dominated galaxies provides such a chance, as it enables an estimate of the BHAD from the star-formation histories (SFHs) of lower-redshift objects. Using the CANDELS Lyman-$α$ Emission At Reionization (CLEAR) survey, we model the SFHs for a sample of 108 bulge-dominated galaxies at $z=$0.7-1.5, and further estimate the BHAD contributed by their high-$z$ progenitors. The predicted BHAD at $z\approx 4$-5 is consistent with the simulation-predicted values, but higher than the X-ray measurements (by $\approx$3-10 times at $z=$4-5). Our result suggests that the current X-ray surveys could be missing many heavily obscured Compton-thick active galactic nuclei (AGNs) at high redshifts. However, this BHAD estimation assumes that the high-$z$ progenitors of our $z=$0.7-1.5 sample remain bulge-dominated where star formation is correlated with BH cold-gas accretion. Alternatively, our prediction could signify a stark decline in the fraction of bulges in high-$z$ galaxies (with an associated drop in BH accretion). JWST and Origins will resolve the discrepancy between our predicted BHAD and the X-ray results by constraining Compton-thick AGN and bulge evolution at high redshifts.

astro-ph.GA↗

arXiv2021

Quantum Many-Body Scars and Quantum Criticality

In this letter, we study the PXP Hamiltonian with an external magnetic field that exhibits both quantum scar states and quantum criticality. It is known that this model hosts a series of quantum many-body scar states violating quantum thermalization at zero magnetic field, and it also exhibits an Ising quantum phase transition driven by finite magnetic field. Although the former involves the properties of generic excited states and the latter concerns the low-energy physics, we discover two surprising connections between them, inspired by the observation that both states possess log-volume law entanglement entropies. First, we show that the quantum many-body scar states can be tracked to a set of quantum critical states, whose nature can be understood as pair-wisely occupied Fermi sea states. Second, we show that the partial violation of quantum thermalization diminishes in the quantum critical regime. We envision that these connections can be extended to general situations and readily verified in existing cold atom experimental platforms.

cond-mat.quant-gas↗

arXiv2020

Active Galactic Nucleus Feedback in an Elliptical Galaxy with the Most Updated AGN Physics: Parameter Explorations

In a previous work, we have proposed a sub-grid model of active galactic nucleus (AGN) feedback by taking into account the state-of-the-art AGN physics, and used that model to study the effect of AGN feedback on the evolution of an isolated elliptical galaxy by performing two dimensional high-resolution (i.e., the Bondi radius is well resolved) simulations. In that work, typical values of model parameters were adopted. In the present work, we extend that study by exploring the effects of uncertainties of parameter values. Such a study is also useful for us to understand the respective roles of various components of the model. These parameters include the mass flux and velocity of AGN wind and radiative efficiency in both the hot and cold feedback modes, and the initial black hole (BH) mass. We find that the velocity of AGN wind in the hot mode is the most important quantity to control the typical accretion rate and luminosity of AGN, and the mass growth of the BH. The effect of the wind on star formation is less sensitive. Within the limited parameter range explored in the current work, a stronger AGN wind suppresses star formation within ~100 pc but enhances star formation beyond this radius, while the star formation integrated over the evolution time and the whole galaxy roughly remain unchanged. AGN radiation suppresses the BH accretion in a mild way, but dust is not considered here. Finally, a smaller initial BH mass results in a more violent evolution of the BH accretion rate. The corresponding AGN spends more time in the high-luminosity state and the percentage of BH mass growth is higher. Our results indicate the robustness of AGN feedback in keeping the galaxy quenched.

astro-ph.GA↗

arXiv2020

Many-Body Localization from Dynamical Gauge Fields

A recent experiment [Nature Physics 10, 1 (2019)] has realized a dynamical gauge system with $\mathbb{Z}_2$ gauge symmetry in a double-well potential. In this work we propose a method to generalize this model from a single double well to a one-dimensional chain. We show that although there is no disordered potential in the original model, the phenomenon of many-body localization can occur. The key ingredient is that different symmetry sectors with different local gauge charges play the role of different disorder configurations, which becomes clear after exactly mapping our model to a transverse Ising model in a random longitudinal field. We show that both the ergodic regime and the many-body localized regime exist in this model from four different metrics, which include level statistics, volume law versus area law of entanglement entropy of eigenstates, quench dynamics of entanglement entropy and physical observables.

cond-mat.quant-gas↗

arXiv2019

Hot Gas Flows on Parsec Scale in the Low-Luminosity Active Galactic Nucleus NGC 3115

NGC 3115 is known as the low-luminosity active galactic nucleus which hosts the nearest ($z\sim0.002$) billion solar mass supermassive black hole ($\sim1.5\times10^9~M_\odot$). Its Bondi radius $r_\mathrm{B}$ ($\sim3\farcs6$) can be readily resolved with Chandra, which offers us an excellent opportunity to investigate the accretion flow onto a supermassive black hole. In this paper, we perform two-dimensional hydrodynamical numerical simulations, tailored for NGC 3115, on the mass flow across the Bondi radius. Our best fittings for the density and temperature agree well with the observations of the hot interstellar medium in the centre of NGC 3115. We find that the flow properties are solely determined by the local galaxy properties in the galaxy centre: (1) stellar winds (including supernova ejecta) supply the mass and energy sources for the accreting gas; (2) similar to the one-dimensional calculations, a stagnation radius $r_\mathrm{st}\sim0.1~r_\mathrm{B}$ is also found in the two-dimensional simulations, which divides the mass flow into an inflow-outflow structure; (3) the radiatively inefficient accretion flow theory applies well inside the stagnation radius, where the gravity is dominated by the supermassive black hole and the gas is supported by rotation; (4) beyond the stagnation radius, the stellar gravity dominates the spherical-like fluid dynamics and causes the transition from a steep density profile outside to a flat density profile inside the Bondi radius.

astro-ph.GA↗

arXiv2018

Strong randomness criticality in the scratched-XY model

We study the finite-temperature superfluid transition in a modified two-dimensional (2D) XY model with power-law distributed "scratch"-like bond disorder. As its exponent decreases, the disorder grows stronger and the mechanism driving the superfluid transition changes from conventional vortex-pair unbinding to a strong randomness criticality (termed scratched-XY criticality) characterized by a non-universal jump of the superfluid stiffness. The existence of the scratched-XY criticality at finite temperature and its description by an asymptotically exact semi-renormalization group theory, previously developed for the superfluid-insulator transition in one-dimensional disordered quantum systems, is numerically proven by designing a model with minimal finite size effects. Possible experimental implementations are discussed.

cond-mat.stat-mech↗

arXiv2016

Superfluid--Insulator Transition in Strongly Disordered One-dimensional Systems

We present an asymptotically exact renormalization-group theory of the superfluid--insulator transition in one-dimensional disordered systems, with emphasis on an accurate description of the interplay between the Giamarchi--Schulz (instanton--anti-instanton) and weak-link (scratched-XY) criticalities. Combining the theory with extensive quantum Monte Carlo simulations allows us to shed new light on the ground-state phase diagram of the one-dimensional disordered Bose-Hubbard model at unit filling.

cond-mat.str-el↗

arXiv2014

Critical Exponents of the Superfluid-Bose Glass Transition in Three-Dimensions

Recent experimental and numerical studies of the critical-temperature exponent $ϕ$ for the superfluid-Bose glass universality in three-dimensional systems report strong violations of the key quantum critical relation, $ϕ=νz$, where $z$ and $ν$ are the dynamic and correlation length exponents, respectively, and question the fundamental concepts underlying quantum critical phenomena. Using Monte Carlo simulations of the disordered Bose-Hubbard model, we demonstrate that previous work on the superfluid-to-normal fluid transition-temperature dependence on chemical potential (or magnetic field, in spin systems), $T_c \propto (μ-μ_c)^ϕ$, was misinterpreting transient behavior on approach to the fluctuation region with the genuine critical law. When the model parameters are modified to have a broad quantum critical region, simulations of both quantum and classical models reveal that the $ϕ=νz$ law [with $ϕ=2.7(2)$, $z=3$, and $ν= 0.88(5)$] holds true, resolving the $ϕ$-exponent "crisis".

cond-mat.str-el↗