Search arXiv⌕ Search

arXiv subjects

Yuntian Chen

Publications and source records attributed to Yuntian Chen.

At least 109 records · Page 6Linked to original sources
arXiv2022

TgDLF2.0: Theory-guided deep-learning for electrical load forecasting via Transformer and transfer learning

Electrical energy is essential in today's society. Accurate electrical load forecasting is beneficial for better scheduling of electricity generation and saving electrical energy. In this paper, we propose theory-guided deep-learning load forecasting 2.0 (TgDLF2.0) to solve this issue, which is an improved version of the theory-guided deep-learning framework for load forecasting via ensemble long short-term memory (TgDLF). TgDLF2.0 introduces the deep-learning model Transformer and transfer learning on the basis of dividing the electrical load into dimensionless trends and local fluctuations, which realizes the utilization of domain knowledge, captures the long-term dependency of the load series, and is more appropriate for realistic scenarios with scarce samples. Cross-validation experiments on different districts show that TgDLF2.0 is approximately 16% more accurate than TgDLF and saves more than half of the training time. TgDLF2.0 with 50% weather noise has the same accuracy as TgDLF without noise, which proves its robustness. We also preliminarily mine the interpretability of Transformer in TgDLF2.0, which may provide future potential for better theory guidance. Furthermore, experiments demonstrate that transfer learning can accelerate convergence of the model in half the number of training epochs and achieve better performance.

cs.LG↗
arXiv2022

Interpretable machine learning optimization (InterOpt) for operational parameters: a case study of highly-efficient shale gas development

An algorithm named InterOpt for optimizing operational parameters is proposed based on interpretable machine learning, and is demonstrated via optimization of shale gas development. InterOpt consists of three parts: a neural network is used to construct an emulator of the actual drilling and hydraulic fracturing process in the vector space (i.e., virtual environment); the Sharpley value method in interpretable machine learning is applied to analyzing the impact of geological and operational parameters in each well (i.e., single well feature impact analysis); and ensemble randomized maximum likelihood (EnRML) is conducted to optimize the operational parameters to comprehensively improve the efficiency of shale gas development and reduce the average cost. In the experiment, InterOpt provides different drilling and fracturing plans for each well according to its specific geological conditions, and finally achieved an average cost reduction of 9.7% for a case study with 104 wells.

cs.LG↗
arXiv2022

AutoKE: An automatic knowledge embedding framework for scientific machine learning

Imposing physical constraints on neural networks as a method of knowledge embedding has achieved great progress in solving physical problems described by governing equations. However, for many engineering problems, governing equations often have complex forms, including complex partial derivatives or stochastic physical fields, which results in significant inconveniences from the perspective of implementation. In this paper, a scientific machine learning framework, called AutoKE, is proposed, and a reservoir flow problem is taken as an instance to demonstrate that this framework can effectively automate the process of embedding physical knowledge. In AutoKE, an emulator comprised of deep neural networks (DNNs) is built for predicting the physical variables of interest. An arbitrarily complex equation can be parsed and automatically converted into a computational graph through the equation parser module, and the fitness of the emulator to the governing equation is evaluated via automatic differentiation. Furthermore, the fixed weights in the loss function are substituted with adaptive weights by incorporating the Lagrangian dual method. Neural architecture search (NAS) is also introduced into the AutoKE to select an optimal network architecture of the emulator according to the specific problem. Finally, we apply transfer learning to enhance the scalability of the emulator. In experiments, the framework is verified by a series of physical problems in which it can automatically embed physical knowledge into an emulator without heavy hand-coding. The results demonstrate that the emulator can not only make accurate predictions, but also be applied to similar problems with high efficiency via transfer learning.

cs.LG↗
arXiv2022

Design optimization of band-pass filter based on parity-time symmetry coupled-resonant

Integrated optical filter based on microring resonators plays a critical role in many applications, ranging from wavelength division multiplexing and switching to channel routing. Bandwidth tunable filters are capable of meeting the on-demand flexible operations in complex situations, due to their advantages of scalability, multi-function, and energy-saving. It has been investigated recently that parity-time (PT) symmetry coupled-resonant systems can be applied to the bandwidth-tunable filters. However, due to the trade-off between the bandwidth-tunable contrast ratio and insertion loss of system, the bandwidth-tunable contrast ratio of this method is severely limited. Here, the bandwidth-tunable contrast ratio is defined as the maximum bandwidth divided by the minimum bandwidth. In this work, we show that high bandwidth-tunable contrast ratio and low insertion loss of system can be achieved simultaneously by increasing the coupling strength between the input port and the resonant. System characterizations under different coupling states reveal that the low insertion loss can be obtained when the system initially operates at the over-coupling condition. A high bandwidth-tunable contrast ratio PT-symmetry band-pass filter with moderate insertion loss is shown on the Silicon platform. Our scheme provides an effective method to reduce the insertion loss of on-chip tunable filters, which is also applicable to the high-order cascaded microring systems.

physics.optics↗
arXiv2022

Nonreciprocal light propagation induced by a subwavelength spinning cylinder

Nonreciprocal optical devices have broad applications in light manipulations for communications and sensing. Non-magnetic mechanisms of optical nonreciprocity are highly desired for high-frequency on-chip applications. Here, we investigate the nonreciprocal properties of light propagation in a dielectric waveguide induced by a subwavelength spinning cylinder. We find that the chiral modes of the cylinder can give rise to unidirectional coupling with the waveguide via the transverse spin-orbit interaction, leading to different transmissions for guided wave propagating in opposite directions and thus optical isolation. We reveal the dependence of the nonreciprocal properties on various system parameters including mode order, spinning speed, and coupling distance. The results show that higher-order chiral modes and larger spinning speed generally give rise to stronger nonreciprocity, and there exists an optimal cylinder-waveguide coupling distance where the optical isolation reaches the maximum. Our work contributes to the understanding of nonreciprocity in subwavelength moving structures and can find applications in integrated photonic circuits, topological photonics, and novel metasurfaces.

physics.optics↗
arXiv2022

Semantic interpretation for convolutional neural networks: What makes a cat a cat?

The interpretability of deep neural networks has attracted increasing attention in recent years, and several methods have been created to interpret the "black box" model. Fundamental limitations remain, however, that impede the pace of understanding the networks, especially the extraction of understandable semantic space. In this work, we introduce the framework of semantic explainable AI (S-XAI), which utilizes row-centered principal component analysis to obtain the common traits from the best combination of superpixels discovered by a genetic algorithm, and extracts understandable semantic spaces on the basis of discovered semantically sensitive neurons and visualization techniques. Statistical interpretation of the semantic space is also provided, and the concept of semantic probability is proposed for the first time. Our experimental results demonstrate that S-XAI is effective in providing a semantic interpretation for the CNN, and offers broad usage, including trustworthiness assessment and semantic sample searching.

cs.LG↗
arXiv2022

Integration of knowledge and data in machine learning

Scientific research's mandate is to comprehend and explore the world, as well as to improve it based on experience and knowledge. Knowledge embedding and knowledge discovery are two significant methods of integrating knowledge and data. Through knowledge embedding, the barriers between knowledge and data can be eliminated, and machine learning models with physical common sense can be established. Meanwhile, humans' understanding of the world is always limited, and knowledge discovery takes advantage of machine learning to extract new knowledge from observations. Knowledge discovery can not only assist researchers to better grasp the nature of physics, but it can also support them in conducting knowledge embedding research. A closed loop of knowledge generation and usage are formed by combining knowledge embedding with knowledge discovery, which can improve the robustness and accuracy of models and uncover previously unknown scientific principles. This study summarizes and analyzes extant literature, as well as identifies research gaps and future opportunities.

cs.AI↗
arXiv2022

High-throughput discovery of chemical structure-polarity relationships combining automation and machine learning techniques

As an essential attribute of organic compounds, polarity has a profound influence on many molecular properties such as solubility and phase transition temperature. Thin layer chromatography (TLC) represents a commonly used technique for polarity measurement. However, current TLC analysis presents several problems, including the need for a large number of attempts to obtain suitable conditions, as well as irreproducibility due to non-standardization. Herein, we describe an automated experiment system for TLC analysis. This system is designed to conduct TLC analysis automatically, facilitating high-throughput experimentation by collecting large experimental data under standardized conditions. Using these datasets, machine learning (ML) methods are employed to construct surrogate models correlating organic compounds' structures and their polarity using retardation factor (Rf). The trained ML models are able to predict the Rf value curve of organic compounds with high accuracy. Furthermore, the constitutive relationship between the compound and its polarity can also be discovered through these modeling methods, and the underlying mechanism is rationalized through adsorption theories. The trained ML models not only reduce the need for empirical optimization currently required for TLC analysis, but also provide general guidelines for the selection of conditions, making TLC an easily accessible tool for the broad scientific community.

physics.chem-ph↗
arXiv2021

Deep-Learning Discovers Macroscopic Governing Equations for Viscous Gravity Currents from Microscopic Simulation Data

Although deep-learning has been successfully applied in a variety of science and engineering problems owing to its strong high-dimensional nonlinear mapping capability, it is of limited use in scientific knowledge discovery. In this work, we propose a deep-learning based framework to discover the macroscopic governing equation of viscous gravity current based on high-resolution microscopic simulation data without the need for prior knowledge of underlying terms. For two typical scenarios with different viscosity ratios, the deep-learning based equations exactly capture the same dominated terms as the theoretically derived equations for describing long-term asymptotic behaviors, which validates the proposed framework. Unknown macroscopic equations are then obtained for describing short-term behaviors, and additional deep-learned compensation terms are eventually discovered. Comparison of posterior tests shows that the deep-learning based PDEs actually perform better than the theoretically derived PDEs in predicting evolving viscous gravity currents for both long-term and short-term regimes. Moreover, the proposed framework is proven to be very robust against non-biased data noise for training, which is up to 20%. Consequently, the presented deep-learning framework shows considerable potential for discovering unrevealed intrinsic laws in scientific semantic space from raw experimental or simulation results in data space.

physics.comp-ph↗
arXiv2021

Chiral polarizer based on encircling EP

Encircling an exceptional point (EP) in a parity-time (PT) symmetric system has shown great potential for chiral optical devices, such as chiral mode switching for symmetric and anti-symmetric modes. However, the chiral switching for polarization states has never been reported although chiral polarization manipulation has significant applications in imaging, sensing, and communication etc. Here inspired by the anti-PT symmetry, we demonstrate an on-chip chiral polarizer by constructing polarization-coupled anti-PT symmetric system for the first time. The transmission axes of the chiral polarizer are different for forward and backward propagation. A polarization extinction ratio of over 10 dB is achieved for both propagating directions. Moreover, a telecommunication experiment is performed to demonstrate the potential applications in polarization encoding signals. It provides a novel functionality for encircling-an-EP parametric evolution and offer a new approach for on-chip chiral polarization manipulation.

physics.optics↗
arXiv2021

Non-Hermitian singularities induced single-mode depletion and soliton formation in microresonators

On-chip manipulation of single resonance over broad background comb spectra of microring resonators is indispensable, ranging from tailoring laser emission, optical signal processing to non-classical light generation, yet challenging without scarifying the quality factor or inducing additional dispersive effects. Here, we propose an experimentally feasible platform to realize on-chip selective depletion of single resonance in microring with decoupled dispersion and dissipation, which are usually entangled by Kramer-Kroning relation. Thanks to the existence of non-Hermitian singularity, unsplit but significantly increased dissipation of the selected resonance is achieved due to the simultaneous collapse of eigenvalues and eigenvectors, fitting elegantly the requirement of pure single-mode depletion. With delicate yet experimentally feasible parameters, we show explicit evidence of modulation instability as well as deterministic single soliton generation in microresonators induced by depletion in normal and anomalous dispersion regime, respectively. Our findings connect non-Hermitian singularities to wide range of applications associated with selective single mode manipulation in microwave photonics, quantum optics, ultrafast optics and beyond.

physics.optics↗
arXiv2021

Any equation is a forest: Symbolic genetic algorithm for discovering open-form partial differential equations (SGA-PDE)

Partial differential equations (PDEs) are concise and understandable representations of domain knowledge, which are essential for deepening our understanding of physical processes and predicting future responses. However, the PDEs of many real-world problems are uncertain, which calls for PDE discovery. We propose the symbolic genetic algorithm (SGA-PDE) to discover open-form PDEs directly from data without prior knowledge about the equation structure. SGA-PDE focuses on the representation and optimization of PDE. Firstly, SGA-PDE uses symbolic mathematics to realize the flexible representation of any given PDE, transforms a PDE into a forest, and converts each function term into a binary tree. Secondly, SGA-PDE adopts a specially designed genetic algorithm to efficiently optimize the binary trees by iteratively updating the tree topology and node attributes. The SGA-PDE is gradient-free, which is a desirable characteristic in PDE discovery since it is difficult to obtain the gradient between the PDE loss and the PDE structure. In the experiment, SGA-PDE not only successfully discovered nonlinear Burgers' equation, Korteweg-de Vries (KdV) equation, and Chafee-Infante equation, but also handled PDEs with fractional structure and compound functions that cannot be solved by conventional PDE discovery methods.

cs.NE↗
arXiv2021

Robust exceptional point of arbitrary order in coupled spinning cylinders

Exceptional points (EPs), i.e., non-Hermitian degeneracies at which eigenvalues and eigenvectors coalesce, can be realized by tuning the gain/loss contrast of different modes in non-Hermitian systems or by engineering the asymmetric coupling of modes. Here we demonstrate a mechanism that can achieve EPs of arbitrary order by employing the non-reciprocal coupling of spinning cylinders sitting on a dielectric waveguide. The spinning motion breaks the time-reversal symmetry and removes the degeneracy of opposite chiral modes of the cylinders. Under the excitation of a linearly polarized plane wave, the chiral mode of one cylinder can unidirectionally couple to the same mode of the other cylinder via the spin-orbit interaction associated with the evanescent wave of the waveguide. The structure can give rise to arbitrary-order EPs that are robust against spin-flipping perturbations, in contrast to conventional systems relying on spin-selective excitations. In addition, we show that higher-order EPs in the proposed system are accompanied by enhanced optical isolation, which may find applications in designing novel optical isolators, nonreciprocal optical devices, and topological photonics.

physics.optics↗
arXiv2021

Optical isolation induced by subwavelength spinning particle via spin-orbit interaction

Optical isolation enables nonreciprocal manipulations of light with broad applications in optical communications. Optical isolation by rotating structures has drawn considerable attention due to its magnetic-free nature and unprecedented performance. Conventional rotation-based optical isolation relies on the use of bulky cavities hindering applications in subwavelength photonics. Here, we propose a novel mechanism of optical isolation by integrating the unique dispersion of a hyperbolic metamaterial with the transverse spin-orbit interaction of evanescent waves. We show that rotation of a subwavelength hyperbolic nanoparticle breaks the time-reversal symmetry and yields two resonant chiral modes that selectively couple to the transverse spin of waveguide modes. Remarkably, the transverse spin-orbit interaction can give rise to unidirectional coupling and $>95\%$ isolation of infrared light at an experimentally feasible rotation speed. Our work fuses the two important fields of optical isolation and photonic spin-orbit interactions, leading to magnetic-free yet compact nonreciprocal devices for novel applications in optical communications, chiral quantum optics, and topological photonics.

physics.optics↗
arXiv2021

DNN2LR: Automatic Feature Crossing for Credit Scoring

Credit scoring is a major application of machine learning for financial institutions to decide whether to approve or reject a credit loan. For sake of reliability, it is necessary for credit scoring models to be both accurate and globally interpretable. Simple classifiers, e.g., Logistic Regression (LR), are white-box models, but not powerful enough to model complex nonlinear interactions among features. Fortunately, automatic feature crossing is a promising way to find cross features to make simple classifiers to be more accurate without heavy handcrafted feature engineering. However, credit scoring is usually based on different aspects of users, and the data usually contains hundreds of feature fields. This makes existing automatic feature crossing methods not efficient for credit scoring. In this work, we find local piece-wise interpretations in Deep Neural Networks (DNNs) of a specific feature are usually inconsistent in different samples, which is caused by feature interactions in the hidden layers. Accordingly, we can design an automatic feature crossing method to find feature interactions in DNN, and use them as cross features in LR. We give definition of the interpretation inconsistency in DNN, based on which a novel feature crossing method for credit scoring prediction called DNN2LR is proposed. Apparently, the final model, i.e., a LR model empowered with cross features, generated by DNN2LR is a white-box model. Extensive experiments have been conducted on both public and business datasets from real-world credit scoring applications. Experimental shows that, DNN2LR can outperform the DNN model, as well as several feature crossing methods. Moreover, comparing with the state-of-the-art feature crossing methods, i.e., AutoCross, DNN2LR can accelerate the speed for feature crossing by about 10 to 40 times on datasets with large numbers of feature fields.

cs.LG↗
arXiv2021

Optically reconfigurable quantum spin-valley Hall effect of light in coupled nonlinear ring resonator lattice

Scattering immune propagation of light in topological photonic systems may revolutionarize the design of integrated photonic circuits for information processing and communications. In optics, various photonic topological circuits have been developed, which were based on classical emulation of either quantum spin Hall effect or quantum valley Hall effect. On the other hand, the combination of both the valley and spin degrees of freedom can lead to a new kind of topological transport phenomenon, dubbed quantum spin valley Hall effect (QSVH), which can further expand the number of topologically protected edge channels and would be useful for information multiplexing. However, it is challenging to realize QSVH in most known material platforms, due to the requirement of breaking both the (pseudo-)fermionic time-reversal (T) and parity symmetries (P) individually, but leaving the combined symmetry S=TP intact. Here, we propose an experimentally feasible platform to realize QSVH for light, based on coupled ring resonators mediated by optical Kerr nonlinearity. Thanks to the inherent flexibility of cross-mode modulation (XMM), the coupling between the probe light can be engineered in a controllable way such that spin-dependent staggered sublattice potential emerges in the effective Hamiltonian. With delicate yet experimentally feasible pump conditions, we show the existence of spin valley Hall induced topological edge states. We further demonstrate that both degrees of freedom, i.e., spin and valley, can be manipulated simultaneously in a reconfigurable manner to realize spin-valley photonics, doubling the degrees of freedom for enhancing the information capacity in optical communication systems.

physics.optics↗
arXiv2021

Theory-guided hard constraint projection (HCP): a knowledge-based data-driven scientific machine learning method

Machine learning models have been successfully used in many scientific and engineering fields. However, it remains difficult for a model to simultaneously utilize domain knowledge and experimental observation data. The application of knowledge-based symbolic AI represented by an expert system is limited by the expressive ability of the model, and data-driven connectionism AI represented by neural networks is prone to produce predictions that violate physical mechanisms. In order to fully integrate domain knowledge with observations, and make full use of the prior information and the strong fitting ability of neural networks, this study proposes theory-guided hard constraint projection (HCP). This model converts physical constraints, such as governing equations, into a form that is easy to handle through discretization, and then implements hard constraint optimization through projection. Based on rigorous mathematical proofs, theory-guided HCP can ensure that model predictions strictly conform to physical mechanisms in the constraint patch. The performance of the theory-guided HCP is verified by experiments based on the heterogeneous subsurface flow problem. Due to the application of hard constraints, compared with fully connected neural networks and soft constraint models, such as theory-guided neural networks and physics-informed neural networks, theory-guided HCP requires fewer data, and achieves higher prediction accuracy and stronger robustness to noisy observations.

cs.LG↗