arXiv subjects

Xin Hong

Publications and source records attributed to Xin Hong.

39 records · Page 3Linked to original sources

arXiv2020

Robust Reinforcement Learning with Wasserstein Constraint

Robust Reinforcement Learning aims to find the optimal policy with some extent of robustness to environmental dynamics. Existing learning algorithms usually enable the robustness through disturbing the current state or simulating environmental parameters in a heuristic way, which lack quantified robustness to the system dynamics (i.e. transition probability). To overcome this issue, we leverage Wasserstein distance to measure the disturbance to the reference transition kernel. With Wasserstein distance, we are able to connect transition kernel disturbance to the state disturbance, i.e. reduce an infinite-dimensional optimization problem to a finite-dimensional risk-aware problem. Through the derived risk-aware optimal Bellman equation, we show the existence of optimal robust policies, provide a sensitivity analysis for the perturbations, and then design a novel robust learning algorithm--Wasserstein Robust Advantage Actor-Critic algorithm (WRAAC). The effectiveness of the proposed algorithm is verified in the Cart-Pole environment.

cs.LG↗

arXiv2019

Deep Fusion Network for Image Completion

Deep image completion usually fails to harmonically blend the restored image into existing content, especially in the boundary area. This paper handles with this problem from a new perspective of creating a smooth transition and proposes a concise Deep Fusion Network (DFNet). Firstly, a fusion block is introduced to generate a flexible alpha composition map for combining known and unknown regions. The fusion block not only provides a smooth fusion between restored and existing content, but also provides an attention map to make network focus more on the unknown pixels. In this way, it builds a bridge for structural and texture information, so that information can be naturally propagated from known region into completion. Furthermore, fusion blocks are embedded into several decoder layers of the network. Accompanied by the adjustable loss constraints on each layer, more accurate structure information are achieved. We qualitatively and quantitatively compare our method with other state-of-the-art methods on Places2 and CelebA datasets. The results show the superior performance of DFNet, especially in the aspects of harmonious texture transition, texture detail and semantic structural consistency. Our source code will be avaiable at: \url{https://github.com/hughplay/DFNet}

cs.CV↗

arXiv2019

How transcranial direct current stimulation facilitates post-stroke rehabilitation

Whether transcranial direct current stimulation (tDCS) benefits stroke rehabilitation remains unclear. To investigate how tDCS reorganizes brain circuitry, nineteen post-stroke patients underwent rehabilitation sessions with bi-hemispheric real vs sham tDCS intervention. Resting motor threshold measurements showed tDCS evoked higher excitability in the motor cortex that enhanced the descending conduction from the lesioned primary motor cortex to the target hand muscle. Granger causality analysis further revealed brain circuitry rewiring among the lesioned cerebellum, premotor, and primary motor cortex in the tDCS group compared to the sham owing to the newly formed connections close to the anodal electrode. Rebuilding of these critical pathways was clear via the increase of event related desynchronisation (ERD) and white matter integrity in the same lesioned region. Furthermore, only the tDCS group demonstrated a positive recovery trend in the penumbra regions by the longitudinal functional magnetic resonance imaging (fMRI) analysis. To interpret tDCS mechanism, we introduce a polarized gamma-aminobutyric acid (GABA) theory, where GABAA receptor activity depends on the orientation of dipolar GABA that can be manipulated by tDCS field. Results suggest that tDCS intervention lowers motor excitability via re-orienting GABA, leading to reorganization of the lesioned cortical network, and the motor descending pathway, finally the recovery of motor function.

physics.med-ph↗