Search arXiv⌕ Search

arXiv subjects

Jie Chen

Publications and source records attributed to Jie Chen.

At least 577 records · Page 32Linked to original sources

Surrogate Locally-Interpretable Models with Supervised Machine Learning Algorithms

Supervised Machine Learning (SML) algorithms, such as Gradient Boosting, Random Forest, and Neural Networks, have become popular in recent years due to their superior predictive performance over traditional statistical methods. However, their complexity makes the results hard to interpret without additional tools. There has been a lot of recent work in developing global and local diagnostics for interpreting SML models. In this paper, we propose a locally-interpretable model that takes the fitted ML response surface, partitions the predictor space using model-based regression trees, and fits interpretable main-effects models at each of the nodes. We adapt the algorithm to be efficient in dealing with high-dimensional predictors. While the main focus is on interpretability, the resulting surrogate model also has reasonably good predictive performance.

stat.ML↗

Supervised Machine Learning Techniques: An Overview with Applications to Banking

This article provides an overview of Supervised Machine Learning (SML) with a focus on applications to banking. The SML techniques covered include Bagging (Random Forest or RF), Boosting (Gradient Boosting Machine or GBM) and Neural Networks (NNs). We begin with an introduction to ML tasks and techniques. This is followed by a description of: i) tree-based ensemble algorithms including Bagging with RF and Boosting with GBMs, ii) Feedforward NNs, iii) a discussion of hyper-parameter optimization techniques, and iv) machine learning interpretability. The paper concludes with a comparison of the features of different ML algorithms. Examples taken from credit risk modeling in banking are used throughout the paper to illustrate the techniques and interpret the results of the algorithms.

q-fin.GN↗

Deep Spatial-angular Regularization for Compressive Light Field Reconstruction over Coded Apertures

Coded aperture is a promising approach for capturing the 4-D light field (LF), in which the 4-D data are compressively modulated into 2-D coded measurements that are further decoded by reconstruction algorithms. The bottleneck lies in the reconstruction algorithms, resulting in rather limited reconstruction quality. To tackle this challenge, we propose a novel learning-based framework for the reconstruction of high-quality LFs from acquisitions via learned coded apertures. The proposed method incorporates the measurement observation into the deep learning framework elegantly to avoid relying entirely on data-driven priors for LF reconstruction. Specifically, we first formulate the compressive LF reconstruction as an inverse problem with an implicit regularization term. Then, we construct the regularization term with an efficient deep spatial-angular convolutional sub-network to comprehensively explore the signal distribution free from the limited representation ability and inefficiency of deterministic mathematical modeling. Experimental results show that the reconstructed LFs not only achieve much higher PSNR/SSIM but also preserve the LF parallax structure better, compared with state-of-the-art methods on both real and synthetic LF benchmarks. In addition, experiments show that our method is efficient and robust to noise, which is an essential advantage for a real camera system. The code is publicly available at \url{https://github.com/angmt2008/LFCA}

eess.IV↗

Adaptive generalized multiscale approximation of a mixed finite element method with velocity elimination

In this paper, we propose offline and online adaptive enrichment algorithms for the generalized multiscale approximation of a mixed finite element method with velocity elimination to solve the subsurface flow problem in high-contrast and heterogeneous porous media. We give the theoretical analysis for the convergence of these two adaptive methods, which shows that sufficient initial basis functions (belong to the offline space) leads to a faster convergence rate. A series of numerical examples are provided to highlight the performance of both these two adaptive methods and also validate the theoretical analysis. Both offline and online adaptive methods are effective that can reduce the relative error substantially. In addition, the online adaptive method generally performs better than the offline adaptive method as online basis functions contain important global information such as distant effects that cannot be captured by offline basis functions. The numerical results also show that with a suitable initial multiscale space that includes all offline basis functions corresponding to relative smaller eigenvalues of local spectral decompositions in the offline stage, the convergence rate of the online enrichment is independent of the permeability contrast.

math.NA↗

Generalized multiscale approximation of a multipoint flux mixed finite element method for Darcy-Forchheimer model

In this paper, we propose a multiscale method for the Darcy-Forchheimer model in highly heterogeneous porous media. The problem is solved in the framework of generalized multiscale finite element methods (GMsFEM) combined with a multipoint flux mixed finite element (MFMFE) method. %In the MFMFE methods, appropriate mixed finite element spaces and suitable quadrature rules are employed, which allow for local velocity elimination and lead to a cell-centered system for the pressure. We consider the MFMFE method that utilizes the lowest order Brezzi-Douglas-Marini ($\textrm{BDM}_1$) mixed finite element spaces for the velocity and pressure approximation. The symmetric trapezoidal quadrature rule is employed for the integration of bilinear forms relating to the velocity variables so that the local velocity elimination is allowed and leads to a cell-centered system for the pressure. %on meshes composed of simplices and $h^2$-perturbed parallelograms. We construct multiscale space for the pressure and solve the problem on the coarse grid following the GMsFEM framework. In the offline stage, we construct local snapshot spaces and perform spectral decompositions to get the offline space with a smaller dimension. In the online stage, we use the Newton iterative algorithm to solve the nonlinear problem and obtain the offline solution, which reduces the iteration times greatly comparing to the standard Picard iteration. Based on the offline space and offline solution, we calculate online basis functions which contain important global information to enrich the multiscale space iteratively. The online basis functions are efficient and accurate to reduce relative errors substantially. Numerical examples are provided to highlight the performance of the proposed multiscale method.

math.NA↗

Asymptotic population imbalance of an ultracold bosonic ensemble in a driven double-well

We demonstrate that an ultracold many-body bosonic ensemble confined in an one-dimensional (1D) double well potential exhibits a population imbalance between the two wells at large timescales, when the depth of the wells are modulated by a time-dependent driving force. The specific form of the driving force is shown to break spatial parity and time-reversal symmetries, which leads to such an asymptotic population imbalance (API). The value of the API can be flexibly controlled by changing the phase of the driving force and the total number of particles. While the API is highly sensitive to the initial state in the few-particle regime, this dependence on the initial state is lost as we approach the classical limit of large particle numbers. We perform a Floquet analysis in the few-particle regime and an analysis based on a driven classical non-rigid pendulum in the many-particle regime. Although the obtained API values in the many-particle regime agree very well with that obtained in the classical limit, we show that there exists a significant disagreement in the corresponding real-time population imbalance due to quantum correlations.

quant-ph↗

Online Graph-Based Change Point Detection in Multiband Image Sequences

The automatic detection of changes or anomalies between multispectral and hyperspectral images collected at different time instants is an active and challenging research topic. To effectively perform change-point detection in multitemporal images, it is important to devise techniques that are computationally efficient for processing large datasets, and that do not require knowledge about the nature of the changes. In this paper, we introduce a novel online framework for detecting changes in multitemporal remote sensing images. Acting on neighboring spectra as adjacent vertices in a graph, this algorithm focuses on anomalies concurrently activating groups of vertices corresponding to compact, well-connected and spectrally homogeneous image regions. It fully benefits from recent advances in graph signal processing to exploit the characteristics of the data that lie on irregular supports. Moreover, the graph is estimated directly from the images using superpixel decomposition algorithms. The learning algorithm is scalable in the sense that it is efficient and spatially distributed. Experiments illustrate the detection and localization performance of the method.

eess.SP↗

Policy Gradient from Demonstration and Curiosity

With reinforcement learning, an agent could learn complex behaviors from high-level abstractions of the task. However, exploration and reward shaping remained challenging for existing methods, especially in scenarios where the extrinsic feedback was sparse. Expert demonstrations have been investigated to solve these difficulties, but a tremendous number of high-quality demonstrations were usually required. In this work, an integrated policy gradient algorithm was proposed to boost exploration and facilitate intrinsic reward learning from only limited number of demonstrations. We achieved this by reformulating the original reward function with two additional terms, where the first term measured the Jensen-Shannon divergence between current policy and the expert, and the second term estimated the agent's uncertainty about the environment. The presented algorithm was evaluated on a range of simulated tasks with sparse extrinsic reward signals where only one single demonstrated trajectory was provided to each task, superior exploration efficiency and high average return were demonstrated in all tasks. Furthermore, it was found that the agent could imitate the expert's behavior and meanwhile sustain high return.

cs.LG↗

Adaptive Explainable Neural Networks (AxNNs)

While machine learning techniques have been successfully applied in several fields, the black-box nature of the models presents challenges for interpreting and explaining the results. We develop a new framework called Adaptive Explainable Neural Networks (AxNN) for achieving the dual goals of good predictive performance and model interpretability. For predictive performance, we build a structured neural network made up of ensembles of generalized additive model networks and additive index models (through explainable neural networks) using a two-stage process. This can be done using either a boosting or a stacking ensemble. For interpretability, we show how to decompose the results of AxNN into main effects and higher-order interaction effects. The computations are inherited from Google's open source tool AdaNet and can be efficiently accelerated by training with distributed computing. The results are illustrated on simulated and real datasets.

stat.ML↗

Self-synchronization of thermal phonons at equilibrium

Self-synchronization is a ubiquitous phenomenon in nature, in which oscillators are collectively locked in frequency and phase through mutual interactions. While self-synchronization requires the forced excitation of at least one of the oscillators, we demonstrate that this mechanism spontaneously appears due to the activation from thermal fluctuations. By performing molecular dynamic simulations, we demonstrate the self-synchronization of thermal phonons in a platform supporting doped silicon resonators. We find that thermal phonons are spontaneously converging to the same frequency and phase. In addition, the dependencies to intrinsic frequency difference and coupling strength agree well with the Kuramoto model predictions. More interestingly, we find that a balance between energy dissipation resulting from phonon-phonon scattering and potential energy between oscillators is required to maintain synchronization. Finally, a wavelet transform approach corroborates the generation of coherent thermal phonons in the collective state of oscillators. Our study provides a new perspective on self-synchronization and on the relationship between fluctuations and coherence.

cond-mat.mes-hall↗

Large anisotropic topological Hall effect in a hexagonal non-collinear magnet Fe5Sn3

We report the observation of a large anisotropic topological Hall effect (THE) in the hexagonal non-collinear magnet Fe5Sn3 single crystals. It is found that the sign of the topological Hall resistivity is negative when a magnetic field H perpendicular to the bc-plane (H\perp bc-plane), however, it changes form negative to positive when H parallel to the c-axis (H\parallel c-axis). The value of topological Hall resistivity increased with the increasing temperature and reached approximately -2.12 μΩcm (H\perp bc-plane) and 0.5 μΩcm (H\parallel c-axis) at 350 K, respectively. Quantitative analyses of the measured data suggest that the observed anisotropic THE may originate from the opposite scalar spin chirality induced by the magnetic fields perpendicular and parallel to the c-axis, respectively.

cond-mat.mtrl-sci↗

Adaptive Distributed Laser Charging for Efficient Wireless Power Transfer

Distributed laser charging (DLC) is a wireless power transfer technology for mobile electronics. Similar to traditional wireless charging systems, the DLC system can only provide constant power to charge a battery. However, Li-ion battery needs dynamic input current and voltage, thus power, in order to optimize battery charging performance. Therefore, neither power transmission efficiency nor battery charging performance can be optimized by the DLC system. We at first propose an adaptive DLC (ADLC) system to optimize wireless power transfer efficiency and battery charging performance. Then, we analyze ADLC's power conversion to depict the adaptation mechanism. Finally, we evaluate the ADLC's power conversion performance by simulation, which illustrates its efficiency improvement by saving at least 60.4% of energy, comparing with the fixed-power charging system.

eess.SY↗

AD-Cluster: Augmented Discriminative Clustering for Domain Adaptive Person Re-identification

Domain adaptive person re-identification (re-ID) is a challenging task, especially when person identities in target domains are unknown. Existing methods attempt to address this challenge by transferring image styles or aligning feature distributions across domains, whereas the rich unlabeled samples in target domains are not sufficiently exploited. This paper presents a novel augmented discriminative clustering (AD-Cluster) technique that estimates and augments person clusters in target domains and enforces the discrimination ability of re-ID models with the augmented clusters. AD-Cluster is trained by iterative density-based clustering, adaptive sample augmentation, and discriminative feature learning. It learns an image generator and a feature encoder which aim to maximize the intra-cluster diversity in the sample space and minimize the intra-cluster distance in the feature space in an adversarial min-max manner. Finally, AD-Cluster increases the diversity of sample clusters and improves the discrimination capability of re-ID models greatly. Extensive experiments over Market-1501 and DukeMTMC-reID show that AD-Cluster outperforms the state-of-the-art with large margins.

cs.CV↗

The Transient Responses of An Axisymmetric Tropical Cyclone to Instantaneous Surface Roughening and Drying. Part I: Numerical Experiments

Inland tropical cyclone (TC) impacts due to high winds and rainfall-induced flooding depend strongly on the evolution of the wind field and precipitation distribution after landfall. However, research has yet to test the detailed response of a mature TC and its hazards to changes in surface forcing in idealized settings. This work tests the transient response of an idealized hurricane to instantaneous transitions in two key surface properties associated with landfall: surface roughening and drying. Simplified axisymmetric experiments are performed in CM1 where surface drag coefficient and evaporative fraction are each systematically modified beneath a mature hurricane. Surface drying stabilizes the eyewall and consequently weakens the overturning circulation, thereby reducing inward angular momentum transport that slowly decays the wind field only within the inner-core. In contrast, surface roughening initially ($\sim$12 hours) rapidly weakens the entire low-level wind field and enhances the overturning circulation dynamically despite the concurrent thermodynamic stabilization of the eyewall; thereafter the storm gradually decays similar to drying. As a result, total precipitation temporarily increases with roughening but uniformly decreases with drying. Storm size decreases monotonically and rapidly with surface roughening, while the radius of maximum wind can increase with moderate surface drying. Overall, this work provides a mechanistic foundation for understanding the inland evolution of real storms in nature.

physics.ao-ph↗

Light Field Spatial Super-resolution via Deep Combinatorial Geometry Embedding and Structural Consistency Regularization

Light field (LF) images acquired by hand-held devices usually suffer from low spatial resolution as the limited sampling resources have to be shared with the angular dimension. LF spatial super-resolution (SR) thus becomes an indispensable part of the LF camera processing pipeline. The high-dimensionality characteristic and complex geometrical structure of LF images make the problem more challenging than traditional single-image SR. The performance of existing methods is still limited as they fail to thoroughly explore the coherence among LF views and are insufficient in accurately preserving the parallax structure of the scene. In this paper, we propose a novel learning-based LF spatial SR framework, in which each view of an LF image is first individually super-resolved by exploring the complementary information among views with combinatorial geometry embedding. For accurate preservation of the parallax structure among the reconstructed views, a regularization network trained over a structure-aware loss function is subsequently appended to enforce correct parallax relationships over the intermediate estimation. Our proposed approach is evaluated over datasets with a large number of testing images including both synthetic and real-world scenes. Experimental results demonstrate the advantage of our approach over state-of-the-art methods, i.e., our method not only improves the average PSNR by more than 1.0 dB but also preserves more accurate parallax details, at a lower computational cost.

cs.CV↗

Large anomalous Hall effect in a hexagonal ferromagnetic Fe5Sn3 single crystal

In this paper, we report an experimental observation of the large anomalous Hall effect (AHE) in a hexagonal ferromagnetic Fe5Sn3 single crystal with current along the b axis and a magnetic field normal to the bc plane. The intrinsic contribution of the anomalous Hall conductance sigma_AH^int was approximately 613 Ω-1 cm-1, which was more than 3 times the maximum value in the frustrated kagome magnet Fe3Sn2 and nearly independent of the temperature over a wide range between 5 and 350 K. The analysis results revealed that the large AHE was dominated by a common, intrinsic term, while the extrinsic contribution, i.e., the skew scattering and side jump, turned out to be small. In addition to the large AHE, it was found the types of majority carriers changed at approximately 275 and 30 K, consistent with the critical temperatures of the spin reorientation. These findings suggest that the hexagonal ferromagnetic Fe5Sn3 single crystal is an excellent candidate to use for the study of the topological features in ferromagnets.

cond-mat.mtrl-sci↗

Learning a Weakly-Supervised Video Actor-Action Segmentation Model with a Wise Selection

We address weakly-supervised video actor-action segmentation (VAAS), which extends general video object segmentation (VOS) to additionally consider action labels of the actors. The most successful methods on VOS synthesize a pool of pseudo-annotations (PAs) and then refine them iteratively. However, they face challenges as to how to select from a massive amount of PAs high-quality ones, how to set an appropriate stop condition for weakly-supervised training, and how to initialize PAs pertaining to VAAS. To overcome these challenges, we propose a general Weakly-Supervised framework with a Wise Selection of training samples and model evaluation criterion (WS^2). Instead of blindly trusting quality-inconsistent PAs, WS^2 employs a learning-based selection to select effective PAs and a novel region integrity criterion as a stopping condition for weakly-supervised training. In addition, a 3D-Conv GCAM is devised to adapt to the VAAS task. Extensive experiments show that WS^2 achieves state-of-the-art performance on both weakly-supervised VOS and VAAS tasks and is on par with the best fully-supervised method on VAAS.

cs.CV↗

Room-temperature ferrimagnetism of anti-site-disordered Ca2MnOsO6

Room-temperature ferrimagnetism was discovered for the anti-site-disordered perovskite Ca2MnOsO6 with Tc = 305 K. Ca2MnOsO6 crystallizes into an orthorhombic structure with a space group of Pnma, in which Mn and Os share the oxygen-coordinated-octahedral site at an equal ratio without a noticeable ordered arrangement. The material is electrically semiconducting with variable-range-hopping behavior. X-ray absorption spectroscopy confirmed the trivalent state of the Mn and the pentavalent state of the Os. X-ray magnetic circular dichroism spectroscopy reveals that the Mn and Os magnetic moments are aligned antiferromagnetically, thereby classifying the material as a ferrimagnet which is in accordance with band structure calculations. It is intriguing that the magnetic signal of the Os is very weak, and that the observed total magnetic moment is primarily due to the Mn. The Tc = 305 K is the second highest in the material category of so-called disordered ferromagnets such as CaRu1-xMnxO3, SrRu1-xCrxO3, and CaIr1-xMnxO3, and hence, may support the development of spintronic oxides with relaxed requirements concerning the anti-site disorder of the magnetic ions.

cond-mat.str-el↗