Search arXiv⌕ Search

arXiv subjects

Zhen Zhang

Publications and source records attributed to Zhen Zhang.

At least 271 records · Page 15Linked to original sources

Physics-Informed Machine Learning for Efficient Reconfigurable Intelligent Surface Design

Reconfigurable intelligent surface (RIS) is a two-dimensional periodic structure integrated with a large number of reflective elements, which can manipulate electromagnetic waves in a digital way, offering great potentials for wireless communication and radar detection applications. However, conventional RIS designs highly rely on extensive full-wave EM simulations that are extremely time-consuming. To address this challenge, we propose a machine-learning-assisted approach for efficient RIS design. An accurate and fast model to predict the reflection coefficient of RIS element is developed by combining a multi-layer perceptron neural network (MLP) and a dual-port network, which can significantly reduce tedious EM simulations in the network training. A RIS has been practically designed based on the proposed method. To verify the proposed method, the RIS has also been fabricated and measured. The experimental results are in good agreement with the simulation results, which validates the efficacy of the proposed method in RIS design.

cs.LG↗

Unsupervised Query Routing for Retrieval Augmented Generation

Query routing for retrieval-augmented generation aims to assign an input query to the most suitable search engine. Existing works rely heavily on supervised datasets that require extensive manual annotation, resulting in high costs and limited scalability, as well as poor generalization to out-of-distribution scenarios. To address these challenges, we introduce a novel unsupervised method that constructs the "upper-bound" response to evaluate the quality of retrieval-augmented responses. This evaluation enables the decision of the most suitable search engine for a given query. By eliminating manual annotations, our approach can automatically process large-scale real user queries and create training data. We conduct extensive experiments across five datasets, demonstrating that our method significantly enhances scalability and generalization capabilities.

cs.IR↗

High-Throughput Studies of Novel Magnetic Materials in Borides

Borides are a versatile material family with various properties for valuable applications. Conventional magnetism, such as ferromagnetism and antiferromagnetism in borides, have been extensively studied. However, research on unconventional magnetism in borides where quantum effects are dominant is scarce. Here, we implement a high-throughput workflow combining first-principles calculations, materials prediction, and magnetic properties calculations to discover novel magnetism and magnetic materials in borides. Successfully applying the workflow, we report three families of novel magnetic borides, including two families of borides exhibiting quantum magnetism. One is a family of dimerized quantum magnets among YCrB$_4$-type borides, which provides a rare platform for studying the spin-gap quantum critical point. The other is a family of altermagnets among FeMo$_2$B$_2$-type borides, extending the magnetic orderings exhibited by borides beyond conventional ferromagnetism and antiferromagnetism. We also predict a family of magnetic laminate transition metal borides, known as the MAB phases, in the AlFe$_2$B$_2$-type family, which provide pure-phase or alloying candidates for studying magnetocaloric materials and the associated magnetic transitions. The workflow is expected to be used in further studies of novel magnetism and magnetic materials.

cond-mat.mtrl-sci↗

Highway Graph to Accelerate Reinforcement Learning

Reinforcement Learning (RL) algorithms often struggle with low training efficiency. A common approach to address this challenge is integrating model-based planning algorithms, such as Monte Carlo Tree Search (MCTS) or Value Iteration (VI), into the environmental model. However, VI requires iterating over a large tensor which updates the value of the preceding state based on the succeeding state through value propagation, resulting in computationally intensive operations. To enhance the RL training efficiency, we propose improving the efficiency of the value learning process. In deterministic environments with discrete state and action spaces, we observe that on the sampled empirical state-transition graph, a non-branching sequence of transitions-termed a highway-can take the agent to another state without deviation through intermediate states. On these non-branching highways, the value-updating process can be streamlined into a single-step operation, eliminating the need for step-by-step updates. Building on this observation, we introduce the highway graph to model state transitions. The highway graph compresses the transition model into a compact representation, where edges can encapsulate multiple state transitions, enabling value propagation across multiple time steps in a single iteration. By integrating the highway graph into RL, the training process is significantly accelerated, particularly in the early stages of training. Experiments across four categories of environments demonstrate that our method learns significantly faster than established and state-of-the-art RL algorithms (often by a factor of 10 to 150) while maintaining equal or superior expected returns. Furthermore, a deep neural network-based agent trained using the highway graph exhibits improved generalization capabilities and reduced storage costs. Code is publicly available at https://github.com/coodest/highwayRL.

cs.LG↗

Gradient polaritonic surface with space-variant switchable light-matter interactions in 2D moire superlattices

Polaritons in two-dimensional (2D) materials provide unique opportunities for controlling light at nanoscales. Tailoring these polaritons via gradient polaritonic surfaces with space-variant response can enable versatile light-matter interaction platforms with advanced functionalities. However, experimental progress has been hampered by the optical losses and poor light confinement of conventionally used artificial nanostructures. Here, we demonstrate natural gradient polaritonic surfaces based on superlattices of solitons-localized structural deformations-in a prototypical moire system, twisted bilayer graphene on boron nitride. We demonstrate on-off switching and continuous modulation of local polariton-soliton interactions, which results from marked modifications of topological and conventional soliton states through variation of local strain direction. Furthermore, we reveal the capability of these structures to spatially modify the near-field profile, phase, and propagation direction of polaritons in record-small footprints, enabling generation and electrical switching of directional polaritons. Our findings open up new avenues toward nanoscale manipulation of light-matter interactions and spatial polariton engineering through gradient moire superlattices.

physics.optics↗

A wideband amplifying and filtering reconfigurable intelligent surface for wireless relay

Programmable metasurfaces have garnered significant attention due to their exceptional ability to manipulate electromagnetic (EM) waves in real time, leading to the emergence of a prominent area in wireless communication, namely reconfigurable intelligent surfaces (RISs), to control the signal propagation and coverage. However, the existing RISs usually suffer from limited operating distance and band interference, which hinder their practical applications in wireless relay and communication systems. To overcome the limitations, we propose an amplifying and filtering RIS (AF-RIS) to enhance the in-band signal energy and filter the out-of-band signal of the incident EM waves, ensuring the miniaturization of the RIS array and enabling its anti-interference ability. In addition, each AF-RIS element is equipped with a 2-bit phase control capability, further endowing the entire array with great beamforming performance. An elaborately designed 4*8 AF-RIS array is presented by integrating the power dividing and combining networks, which substantially reduces the number of amplifiers and filters, thereby reducing the hardware costs and power consumption. Experimental results showcase the powerful capabilities of AF-RIS in beam-steering, frequency selectivity, and signal amplification. Therefore, the proposed AF-RIS holds significant promise for critical applications in wireless relay systems by offering an efficient solution to improve frequency selectivity, enhance signal coverage, and reduce hardware size.

eess.SP↗

Deep Searches for Radio Pulsations and Bursts from Four Magnetar and a Magnetar-like pulsar with FAST

We report on radio observations of four magnetars SGR 0501+4516, Swift 1834.9-0846, 1E 1841-045, SGR 1900+14 and a magnetar-like pulsar PSR J1846-0258 with the Five-hundred-meter Aperture Spherical radio Telescope (FAST) at 1250 MHz. Notably, PSR J1846-0258 was observed one month after its 2020 X-ray outburst. The data from these observations were searched for periodic emissions and single pulses. No radio emission was detected for any of our targets. After accounting for the effect of red noise, the non-detections yield stringent upper limits on the radio flux density, with $S_{1250} \leq 16.9\, μ$Jy for the four magnetars and the magnetar-like pulsar, along with constraints on single-pulse flux densities. Our deep radio observations suggest that these magnetars and the magnetar-like pulsar are indeed radio-quiet sources or unfavorably beamed. The resulting flux upper limits, along with previous findings, are discussed, highlighting the significance of further radio observations of radio-quiet magnetars and the high-B magnetar-like pulsar.

astro-ph.HE↗

Nonlinear valley Hall effect in a bilayer transition metal dichalcogenide

Valley-contrasting Hall transport conventionally relies on the inversion symmetry breaking in two-dimensional systems, which greatly limits the selection range of valley materials. In particular, while monolayer transition metal dichalcogenides have been widely utilized as a well-known class of valley materials in valleytronics, the centrosymmetric nature hinders the realization of valley-contrasting properties in the bilayer counterparts. Here, taking MoS$_{2}$ as an example, we discover valley-contrasting transport in bilayer transition metal dichalcogenides by exploring nonlinear transport regime. Using effective models and first-principles calculations, our work demonstrates that nonvanishing nonlinear valley Hall conductivities emerge in a uniaxially strained MoS$_{2}$ bilayer, owing to strain-induced band tilts of Dirac fermions. With the aid of small spin-orbit-coupling induced band splittings, the conduction bands generate much remarkable nonlinear valley Hall conductivity. Moreover, the nonlinear conductivities are highly tunable through modulating the strength and the direction of the strain, chemical potential, and interlayer gap. Our findings not only expands material choices for valleytronic applications, but also provides opportunities for designing advanced electronic devices that leverage nonlinear valley transports.

cond-mat.mes-hall↗

SDM-Car: A Dataset for Small and Dim Moving Vehicles Detection in Satellite Videos

Vehicle detection and tracking in satellite video is essential in remote sensing (RS) applications. However, upon the statistical analysis of existing datasets, we find that the dim vehicles with low radiation intensity and limited contrast against the background are rarely annotated, which leads to the poor effect of existing approaches in detecting moving vehicles under low radiation conditions. In this paper, we address the challenge by building a \textbf{S}mall and \textbf{D}im \textbf{M}oving Cars (SDM-Car) dataset with a multitude of annotations for dim vehicles in satellite videos, which is collected by the Luojia 3-01 satellite and comprises 99 high-quality videos. Furthermore, we propose a method based on image enhancement and attention mechanisms to improve the detection accuracy of dim vehicles, serving as a benchmark for evaluating the dataset. Finally, we assess the performance of several representative methods on SDM-Car and present insightful findings. The dataset is openly available at https://github.com/TanedaM/SDM-Car.

cs.CV↗

LinkNER: Linking Local Named Entity Recognition Models to Large Language Models using Uncertainty

Named Entity Recognition (NER) serves as a fundamental task in natural language understanding, bearing direct implications for web content analysis, search engines, and information retrieval systems. Fine-tuned NER models exhibit satisfactory performance on standard NER benchmarks. However, due to limited fine-tuning data and lack of knowledge, it performs poorly on unseen entity recognition. As a result, the usability and reliability of NER models in web-related applications are compromised. Instead, Large Language Models (LLMs) like GPT-4 possess extensive external knowledge, but research indicates that they lack specialty for NER tasks. Furthermore, non-public and large-scale weights make tuning LLMs difficult. To address these challenges, we propose a framework that combines small fine-tuned models with LLMs (LinkNER) and an uncertainty-based linking strategy called RDC that enables fine-tuned models to complement black-box LLMs, achieving better performance. We experiment with both standard NER test sets and noisy social media datasets. LinkNER enhances NER task performance, notably surpassing SOTA models in robustness tests. We also quantitatively analyze the influence of key components like uncertainty estimation methods, LLMs, and in-context learning on diverse NER tasks, offering specific web-related recommendations. Code is available at https://github.com/zhzhengit/LinkNER.

cs.CL↗

Dynamic Graph Transformer with Correlated Spatial-Temporal Positional Encoding

Learning effective representations for Continuous-Time Dynamic Graphs (CTDGs) has garnered significant research interest, largely due to its powerful capabilities in modeling complex interactions between nodes. A fundamental and crucial requirement for representation learning in CTDGs is the appropriate estimation and preservation of proximity. However, due to the sparse and evolving characteristics of CTDGs, the spatial-temporal properties inherent in high-order proximity remain largely unexplored. Despite its importance, this property presents significant challenges due to the computationally intensive nature of personalized interaction intensity estimation and the dynamic attributes of CTDGs. To this end, we propose a novel Correlated Spatial-Temporal Positional encoding that incorporates a parameter-free personalized interaction intensity estimation under the weak assumption of the Poisson Point Process. Building on this, we introduce the Dynamic Graph Transformer with Correlated Spatial-Temporal Positional Encoding (CorDGT), which efficiently retains the evolving spatial-temporal high-order proximity for effective node representation learning in CTDGs. Extensive experiments on seven small and two large-scale datasets demonstrate the superior performance and scalability of the proposed CorDGT. The code is available at: https://github.com/wangz3066/CorDGT.

cs.LG↗

Adaptive Optimizers with Sparse Group Lasso for Neural Networks in CTR Prediction

We develop a novel framework that adds the regularizers of the sparse group lasso to a family of adaptive optimizers in deep learning, such as Momentum, Adagrad, Adam, AMSGrad, AdaHessian, and create a new class of optimizers, which are named Group Momentum, Group Adagrad, Group Adam, Group AMSGrad and Group AdaHessian, etc., accordingly. We establish theoretically proven convergence guarantees in the stochastic convex settings, based on primal-dual methods. We evaluate the regularized effect of our new optimizers on three large-scale real-world ad click datasets with state-of-the-art deep learning models. The experimental results reveal that compared with the original optimizers with the post-processing procedure which uses the magnitude pruning method, the performance of the models can be significantly improved on the same sparsity level. Furthermore, in comparison to the cases without magnitude pruning, our methods can achieve extremely high sparsity with significantly better or highly competitive performance. The code is available at https://github.com/intelligent-machine-learning/tfplus/tree/main/tfplus.

cs.LG↗

Identifiable Latent Polynomial Causal Models Through the Lens of Change

Causal representation learning aims to unveil latent high-level causal representations from observed low-level data. One of its primary tasks is to provide reliable assurance of identifying these latent causal models, known as identifiability. A recent breakthrough explores identifiability by leveraging the change of causal influences among latent causal variables across multiple environments \citep{liu2022identifying}. However, this progress rests on the assumption that the causal relationships among latent causal variables adhere strictly to linear Gaussian models. In this paper, we extend the scope of latent causal models to involve nonlinear causal relationships, represented by polynomial models, and general noise distributions conforming to the exponential family. Additionally, we investigate the necessity of imposing changes on all causal parameters and present partial identifiability results when part of them remains unchanged. Further, we propose a novel empirical estimation method, grounded in our theoretical finding, that enables learning consistent latent causal representations. Our experimental results, obtained from both synthetic and real-world data, validate our theoretical contributions concerning identifiability and consistency.

cs.LG↗

Revisiting, Benchmarking and Understanding Unsupervised Graph Domain Adaptation

Unsupervised Graph Domain Adaptation (UGDA) involves the transfer of knowledge from a label-rich source graph to an unlabeled target graph under domain discrepancies. Despite the proliferation of methods designed for this emerging task, the lack of standard experimental settings and fair performance comparisons makes it challenging to understand which and when models perform well across different scenarios. To fill this gap, we present the first comprehensive benchmark for unsupervised graph domain adaptation named GDABench, which encompasses 16 algorithms across 5 datasets with 74 adaptation tasks. Through extensive experiments, we observe that the performance of current UGDA models varies significantly across different datasets and adaptation scenarios. Specifically, we recognize that when the source and target graphs face significant distribution shifts, it is imperative to formulate strategies to effectively address and mitigate graph structural shifts. We also find that with appropriate neighbourhood aggregation mechanisms, simple GNN variants can even surpass state-of-the-art UGDA baselines. To facilitate reproducibility, we have developed an easy-to-use library PyGDA for training and evaluating existing UGDA methods, providing a standardized platform in this community. Our source codes and datasets can be found at: https://github.com/pygda-team/pygda.

cs.LG↗

Multiple-partition cross-modulation programmable metasurface empowering wireless communications

With the versatile manipulation capability, programmable metasurfaces are rapidly advancing in their intelligence, integration, and commercialization levels. However, as the programmable metasurfaces scale up, their control configuration becomes increasingly complicated, posing significant challenges and limitations. Here, we propose a multiple-partition cross-modulation (MPCM) programmable metasurface to enhance the wireless communication coverage with low hardware complexity. We firstly propose an innovative encoding scheme to multiply the control voltage vectors of row-column crossing, achieving high beamforming precision in free space while maintaining low control hardware complexity and reducing memory requirements for coding sequences. We then design and fabricate an MPCM programmable metasurface to confirm the effectiveness of the proposed encoding scheme. The simulated and experimental results show good agreements with the theoretically calculated outcomes in beam scanning across the E and H planes and in free-space beam pointing. The MPCM programmable metasurface offers strong flexibility and low complexity by allowing various numbers and combinations of partition items in modulation methods, catering to diverse precision demands in various scenarios. We demonstrate the performance of MPCM programmable metasurface in a realistic indoor setting, where the transmissions of videos to specific receiver positions are successfully achieved, surpassing the capabilities of traditional programmable metasurfaces. We believe that the proposed programmable metasurface has great potentials in significantly empowering the wireless communications while addressing the challenges associated with the programmable metasurface's design and implementation.

physics.app-ph↗

A versatile framework for attitude tuning of beamlines at advanced light sources

Aside from regular beamline experiments at light sources, the preparation steps before these experiments are also worth systematic consideration in terms of automation; a representative category in these steps is attitude tuning, which typically appears in names like beam focusing, sample alignment etc. With the goal of saving time and manpower in both writing and using in mind, a Mamba-based attitude-tuning framework is created. It supports flexible input/output ports, easy integration of diverse evaluation functions, and free selection of optimisation algorithms; with the help from Mamba's infrastructure, machine learning (ML) and artificial intelligence (AI) technologies can also be readily integrated. The tuning of a polycapillary lens and of an X-ray emission spectrometer are given as examples for the general use of this framework, featuring powerful command-line interfaces (CLIs) and friendly graphical user interfaces (GUIs) that allow comfortable human-in-the-loop control. The tuning of a Raman spectrometer demonstrates more specialised use of the framework with customised optimisation algorithms. With similar applications in mind, our framework is estimated to be capable of fulfilling a majority of attitude-tuning needs. Also reported is a virtual-beamline mechanism based on easily customisable simulated detectors and motors, which facilitates both testing for developers and training for users.

physics.ins-det↗

Attosecond Coherent Electron Motion in a Photoionized Aromatic Molecule

In molecular systems, the ultrafast motion of electrons initiates the process of chemical change. Tracking this electronic motion across molecules requires coupling attosecond time resolution to atomic-scale spatial sensitivity. In this work, we employ a pair of attosecond x-ray pulses from an x-ray free-electron laser to follow electron motion resulting from the sudden removal of an electron from a prototypical aromatic system, para-aminophenol. X-ray absorption enables tracking this motion with atomic-site specificity. Our measurements are compared with state-of-the-art computational modeling, reproducing the observed response across multiple timescales. Sub-femtosecond dynamics are assigned to states undergoing non-radiative decay, while few-femtosecond oscillatory motion is associated with electronic wavepacket motion in stable cation states, that will eventually couple to nuclear motion. Our work provides insight on the ultrafast charge motion preceding and initiating chemical transformations in moderately complex systems, and provides a powerful benchmark for computational models of ultrafast charge motion in matter.

physics.chem-ph↗

DOFS: A Real-world 3D Deformable Object Dataset with Full Spatial Information for Dynamics Model Learning

This work proposes DOFS, a pilot dataset of 3D deformable objects (DOs) (e.g., elasto-plastic objects) with full spatial information (i.e., top, side, and bottom information) using a novel and low-cost data collection platform with a transparent operating plane. The dataset consists of active manipulation action, multi-view RGB-D images, well-registered point clouds, 3D deformed mesh, and 3D occupancy with semantics, using a pinching strategy with a two-parallel-finger gripper. In addition, we trained a neural network with the down-sampled 3D occupancy and action as input to model the dynamics of an elasto-plastic object. Our dataset and all CADs of the data collection system will be released soon on our website.

cs.CV↗